2b ;%*% 106 

"■tlJ 9 ' 
AST HOB 
TITLE . 



INSTITUTION 
SEONS AGENCY 

[ 

EEFOBT NO 
FOB EATE 
CONTBACT 
NG*E * 



BDBS FRICE 
DESCEIFTOES 



IDENTIFIES? 



DOCUHEHT BESOME 



95 



TH 006 36 



labler, Kenneth / ' 

National Longitudinal StiMy of the High School Class 
of 1972: First Fcftlowttp Survey Design, Instrument 
Preparation, Data Coilec.tion and File Development. 
National Center for Education Statistics (DHEW) , 
Sashington, D.C 

Office of the Assistant Secretary for Education 
'. (DBBV),y Washington , D. C. . J - 

NCES-77-262 
77 

OEC-0-73-6666, n • 

48p.; For trelated documents, see-ED 110 730, 117 155, 
120 202, Y20 251 and 133 33a ; Some parts may be * 
marginallyvj^gible due- to small print of the* original j 
document' - 

M:I-$'0v83 HC-$2.C6 Plus Postage. 

Data Analysis; *Data Bases; Data Collection; Fbllowup 
Studies; *High School' Graduates; High Schools; 
Information Utilization; Interviews; * Longitudinal 
Studies; Models; *National Surveys;- Post v §econdary 
Education; Questionnaires; *Researc?h Design; Research 
Methodology; Sampling; Seniors; Test Construction; 
Weighted Scores. 

* National Longitudinal Study High School yclass 
19 72 / 



ABSTRACT * ' • ' ,'* 

Activities, involved in the collection and assembling 

of data for computer processing from the first follovup survey pf the 

National Longitudinal Study of the High School Class/of 1972 (NLS) 

are briefly described. Included ase an overview of the NLS; the 

sample design and survey participation ; the development the first 

fbllowup survey questionnaires; the means Used for maximizing 

participation and resp<?nse; the preparation of the NLS Data File; and 

tjie calculations of score weights . (MV) 



****** ****************** ************************************ 

* Documents acquired by ERIC include many informal unpubMshed * 

* materials not available from other sources. EftIC makes ever^effort * 
*:* to obtain the best copy available, nevertheless, items of marginal * 

* reproducibility are often encountered and this affects the quality * 

* of the^micrcfiche and hardcopy reproductions ERIC makes available * 

* via the ERIC Document Reproduction /Service (EDRS) . .EDRS iC3 not * 

* responsible for the quality of theV original document. Reproductions * 

* supplied by EDRS are the best that* can be made from the! original. * 
****** *****'************************^^ 



sponsored Reports series 

US DEPARTMENT OF HEALTH, 
EDUCATION ft WELFARE 
NATIONAL INSTITUTE OF 
EDUCATION 

THIS DOCUMENT. MAS BEEN REPRO- 
DUCED EXACTLY AS RECEIVED FR»M 
THE PERSON OR ORGANIZATION ORIGIN- 
ATING IT POINTS OF VIEW OR OPINIONS 
STATED DO NOT NECESSARILY REPRE« 
SENT OFFICIAL NATIONAL INSTITUTE OF 
EDUCATION POSITION OR POLICY 

FIRST >F0LL0WUP SURVEY DESIGN, 
INSTRUMENT PREPARATION, DATA 
COLLECTION, AND FILE DEVELOPMENT 




NATIONAL LONGITUDINAL STUDY 

OF THE HIGH SCHOOL CLASS OF 1972 

d 

ERIC 



NAT^NAL LONGITUDINAL STUDY OF, THE tflGHICHOOL CLASS OP1972 



RSJ F0LL0W0P SURVfeY DESIGN, INSTRUMENT PREPARATION, 
DATA COLLECTION, AND FItE DEVELOPMENT 



Project Officer f 

j f . Kenneth T^bler 
National Center for Ejucation'Statistics 

.0 




4 



U.S. D^PARTMENTOF HEALTH] EDUCATION, AND WELFARE 

Joseph A. s Califano, Jr., Secretary \ ' 

Education Division 

Mary F. Berry, Assistant Secretary for Education 

• -\ ■ 

National Center for Education Statistics * ..■ 

^ -Marie D* Eldridge, Administrator 



NATIONAL CENTER FOR EDUCATION STATISTICS - ■ 

purpose of the Center shall be to collect and disseminate. statistics ; 
data related to education in thd Unit'ed States and in other nations, 
r shall . . . collect, collate, and, from tirae v to time, report full * 
ete statistics on the conditions of education in.the United States;^ 
and publish reports on specialized analyses of the, meaning and signi- 
<k such statistics; ... and review and report 6n education activities 
Lgn countries .."—Section 406(b) of the General Education Provisions Act, 
ded (20 U.S.C, 1221e-l). " . ' \. \ 



repared, under contract No. OEC-O-73-6666 with the O.S. Department 
Sf Health, Education, and Welfare. Contractors undertaking such 
projects are encouraged to express freely their professional 
judgment. This report, therefore, does not necessarily represent 
'positions or policies of the Education Division, and no official 
endorsement.should.be inferred. v 



U.S. GOVERNMENT PRINTING OFFICE 
WASHINGTON: 1977* 



For sate by the Sujk rintendent of Documents, U.S. Government Printing Offlco 
Washington, D.C. 20402 



Stock No. 017-080-01723-7 



FOREWORD 

> i 

t This report is a brief description of the activities involved in the collection and 
assembling of data for computer processing from .the first followup survey of the National 
Longitudinal Study of the High Schbol Class of 1972 (NLS). The survey was initiated in 
October 1973 with the, mailing of a questionnaire followed by various reminder 
communications and tracing procedures. At the end of approximately '3 months, 
questionnaire data qji the mail noh respondents Were, to the extent possible, obtained by 
personal interviews. The success of tJ|iese efforts is attested to by the response rate of 93 
percent. 

The initial byproduct of the involvement of the NLS respondents is the conversion of 
their questionnaire responses and the development of a longitudinal data- base for use by 
the many policymakers and researchers who will be needing and analyzing these and 
jubsequen^ data collections for years to cbme. The process by whjch the study 
accomplished its objectives and succeeded in compiling the resultant data file is reported 
herein. i 1 

" " * \ / ': • * 

' - ,T . 

t " , ' » " ' 

1 Elmer F, Collins, Acturg Director 

Longitudinal Studies Branch ( . Division of Multilevel Education' 

J . Statistics ^ : . ' 
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.Chapter I 



OVERVIEW: THE NATIONAL LONGITUDINAL STUDY 
OF THE CLASS OF 1972 



A. Data Needs of Policymakers and 

Researchers , • 

In I9(>8 the National Center for Education Statistics 
(NCES) conducted a survey, to determine (he data 
needs of educational policy luakers and researchers. 
Survey responses indicate*! neetfy for data that would 
ajlbw student edu^Ueilal vocaiionaJ experiences to be 
compared with later cducationar-occu^ationaj. out- 
comes. This finding provided the impetus for NCES Co 
begin planning the first of a" series of national longi- 
tudinal studies. 

Although the educational-vocational development 
of young people after high school has been studied, 
necessary information is lacking for at least three 
reasons. First, social and econorrm: factors change over 
time and affect drastically the edacational-vocational 
progress of young people; for example^ the Project 
Talent 1 longitudinal survey of the early l°6lVs is not 
relatable to the open-door colleges, modal proportions 
of minorities entering colleges, etc.. of the 1970Y 
Second, many studies ard concerned with only one 
class of antecedent variables for explaining later devel- 
opments, and thus fail to take account of interventions 
1 emanating from current Federal priorities and to 
include representative samples with sufficient numbers 
of important subgroups (e.g.. racial-ethnic minorities). 
Third, marn/ studies are primarily concerned with 
developing models or theories of behavior (e.g., Donald 
Super's Career Pattern Stu4y 2 ) an objective not alien 
to but insufficient for the objectives of the National 
Longitudinal Study of the Class of 1972 (NLS). 
'Behavioral studies ftave given, however, an excellent 
basis for, perfecting. the NLS 'design. For indeed, the 

1 John C: Flanagan and William W. Cooley. 1966. Project 
Talent One-Year Follow-Up Studies. University of Pittsburg. 
' 1 E. D. Super, R. S. Kowaski, and E. M. Gotkin. 1967. 
Floundering and Trial After High School. .Career Pattern Study 
Monograph PV. Nejw York: Columbia University. m J , 



continuing planning has relied considerably on the 
review and synthesis of the findings of studios that 
apply to educational-vocational development/such as 
the one by UCLA's Evaluation Center 3 for the U.S. 
Office of Education (QE). £ 

In April. 1970, educational researchers and adminis- 
trators met with Federal officials in Washington. D.C. 
The NLS reflects their guidartce and the data needs of 
• NCES and several OE agencies: the Office of Planning. 
Budgeting, arid Evaluation, the Bureau of Post- 
secondary Education; the Bureau of Occupational and 
Adult Education; and the Bureau of Education for the 
Handicapped. Four advisory committees guided the 
NLS planning. One committee was composed of 
research experts and representatives of educational 
organizations; two others wdre made up of officials of 
State education agencies; and the fourth, an internal 
^ OE user's committee, represented offices and bureaus 
of the Department of Healt^. Education, and Wtlfare 
(HEW)/ ' 1 

Later in 1970. the basic survey* planning was 
contracted to Research Triangle Institute (RT1) and 
the sample planning and design to WESTAT, Inc.* Af- 
ter extensive planning, which included the design and 
field testing of survey instrumentation, and procedures^ 
the first full-scale NLS survey was initiated in the 
spring of 1972. 

B. Data Collections. 1972-73 ~* 

In 1972, a national probability sample of more than 
18.000 seniors from 1 ,070 public, private.l and church- 
affiliated higl\ schools participated in th\ base-year 

s James W. Trent, Claire Rose, Ann Salyard, Juod Adams. 
Alfred C. Marc^ J. Ward Keesling, and Arthur Gertt. 1972. 
An Analytical Review of Longitudinal and Related Studies as- 
# * They Apply\gp the Educational Process. Los Angeles: Center 
for the Study of Evaluation, UCLA. 

4 WFSTAT, Inc. 1972. Sample Design for the Selection of a 
Sample of Schools With % Twelfth-Graders for a Longitudinal 
' Study. R6ckv\\\e t Maryland. 



survey c 
(ETC). 1 



ducted by* kducalmnal Testing Service 



I. Base- Year Student Survey fnstrumcnis 

Each student rn the sample was asked to com- 
• plete a Student Questionnaire containing 104 questions 
distributed over 11 sections . The questions dealt with 
personal-family background, educational and work 
experiences', plans, aspirations, attitudes, and opinions. 
Students ware ^iven the option of completing the 
que*:ionnaire in school or taking it home to get 
assistance from their parents. Those selected lor the 
survey were informed in the, questionnaire and in a 
newsletter of the voluntary nature of participation, of 
their prerogative to skip questions they Vonsidered 
personally sensitive: and of the objectives and im- 
portance of the study for future educational benefits. 
Participants were assured that their responses would be' 
treated as confidential, that they would remain anony- 
mous, and that data collected by the survey would be 
^published only in aggregate form. 
<C ^0 Each student was also asked to* complete a 
69 minute Test Book designed to measure both verbal 
and nonverbal .abilities. The book contained sft tests 
which are described briefly beiow in the order of 
administration: 

Vocabulary- A brief te;jt using synonym format. 
The" items were selected to avoid academic or 
. '.collegiate bias and to be on an appropriate level of 
difficulty for the 12th-grade population. (1.5 items. 
5 minutes>^' 

Picture number. A test of associative memory 
consisting of drawings of familiar objects, each 
paired with *a number. The student, after studying 
the picture-number pairs, was asked, to recall the 
number associated with each object. (30 items. 10 
minutes) . 

i a ■ 

Reeling) A test based on 100-200 word passages 
with questions concerning various reading skills 
(analysis, interpretation)' and focused on straight- 
forward comprehension. With the vocabulary test.it 
provided a means to derive a verbal score .which 
could allow links toJhe normative data available for 
the SAT. (20 items, 15 minutes) 



■Educational Teskng Service. ^973. The Base-Year Survey 
of the National Longitudinal Study' of the High School Class of 
* L972-Flnal Report. Princet$:i, New Jersey. 



I vttcr groups. A tost of inductive leasonltigjcquii 
mg the student to draw general concepts horn. sets 
nf data or to form and try out hypotheses in a 
, nonverbal context. The items had five groups! ol 
letteis, fouc groups shared a common characteristic. 
Thy student indicated which group differed I mm 
the others. (25 items, 15 minutes) 

Mathematics. Quantitative ^comparisons requiring 
the student either to indicate which of two quanti- 
ties is greater or to assert equality or the lack ol 
data for comparing. This item was relatively quickly 
answered and provided measures of basic compe- 
tence in mathematics, (25 items. 15 minutes) 

Mosaic comparisons. A test of perceptual speed and 
accuracy with items requiring that small differences 
be detected between pairs of otherwise identical 
mosaics or tile-like patterns. A deliberately speeded 
test, it had three separately timed sections of 
increasingly complex patterns. (116 items. l > min- 
utes) 

From each student's School Record Information' 
Form (SRIF). tfata were obtained on theTugh school 
curriculum, grade poinY average, credit hours in major 
courses, position in ability groupings (if applicable), 
remedial-instruction record, . involvement in certain 
federally supported programs, and scores on standard- 
ized tests. . 

2. School and Counselor Survey Instruments 

Two other data collection instruments were the 
School Questionnaire ana the Counselor Questionnaire. 
Survey administrators completed the School Question- 
naire, which provided information on- 

Programs and students. Grade structure, enrollment 
by curriculum, programs for the handicapped and ( 
disadvantaged, teaching, abserice and dropout rates, 
racial-ethnic makeup, college recruitment effort^. 

[Resources. Participation in Federal programs, 
teacher turnover, percentage of teachers with ad- 
vanced degrees, library and other facilities, age of > 
buildings, nearness to postsecondary institutions 

Grading systems. Form of 'the system in use. plus a 
table of grade equivalents 

' ■ 

A maximum of two counselors in each school filled in 



the Counselor Uucslionuaiie with data on turning, 
experience, acTfyties, assignments. nuMhoils. woikload, 
and resources. 

3. Folio wup Surveys 

In (he summer of i l >73, 4.4.19 student who did 
not participate in 1972 were contacted ("lesmvvycil") 
to be added to the planned followup sample. 

in October of 1 97.*, the first followup survey 
was begun by RTl Of the 22/>54 young adults 
expected to participate, 94.2 percent completed the 
first followup instruments M.H percent hy mail and 
32.4 percent by personal interview. Participants were 
asked in First Followup ^Questionnaires where they 
were in October 1 c >7 3 and what they were doing with 
regard to work, education, and/or training. Similar 
questions were also asked for the same period in 1972 
to facilitate the tracing of progress since high school 
and the defining of factors that affect that progress. 
The first followup data collection was completed in 
April of 1974. (Content of the First, Followup Ques- 
tionnaire is covered in detail in chapter III of this 
reporti first followup data collection activities are 
discussed in chapter IV.) 

• The second followup survey was begun hy. RTl 
in October 1974, with data collection completed in 
April of l ( >75. A third followup of the class of 1972 
was begun in the fall of 1976. 



vide quantitative data lor policvmakci", planners, and 
lescaicheis oboul v inous issues 



C. Use^for NLS Data 

Periodically, data are being obtained from .members 
of the class of 197;* arid added to thfiir" individual 
histories that is, to their experiences, activities, atti- 
tudes, satisfactions, environments, and plans as they 
move into the critical yea'rs ol early adulthood. These 
data will fill widespread needs of the educational 
community researchers and administrators in the ele- 
mentary, secondary, and postsceondary educational 
occupational systems. The data will p'rovide^ insights 
into identifying and understanding the major branching 
or decision points that affect thf educational and life 
patterns in the immediate pojUsecofldary period. Signif- 
icant linkages of patfisixot&s can be traced, associated 
transition probabilities can be estimated, and insight 
into the relative importance of factors which cjetermin^ 
these probabilities can be realized. 

1 . To Clarify Choices and Alternatives 1 

^ « Collectively, thj individual histories should pro- 
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The demai id 

liaimijg. including vocational/tec 

- -\ ) ^ 

I he abilities and charitelcrislisA oraitual and 

potential uU'is ol postsecundaiy education 

The extent to which earlier plans and aspirations 
persist over tune and are eventually fulfilled 

l ive reasons why young adults change their plans 
and fail to accomplish earlier objectives 

The impact of federally funded postsecondary 
programs on initial choices and*' later activities 
and plans 

The factors influencing young people in choosing 
their lifework and in determining success and 
satisfaction in this work 

The extent to which educational experiences 
have prepared young people for their work 

The characteristics and abilities of those making 
occupational choices and the reasons wlty 
choices are made ' w 

The impact of high school experiences, curricu- 
lums. peer-group aspirations, guidance counsel- 
ing, 1 etc., on initial educational and occupational 
plans and on perseverance arfd success in acJucv- 
ing them . 

Young adults' awareness of educational and 
occupational alternatives, their perceptions of 
options open -to them, and the extent to which 
they have been limited by lack of information 

Financial characteristics in setting Ipw-aspiration 
goals and in failing to meet high-aspiration goal* 



2. To Trace Progress 

The primary NLS purpose is to discover what 
happens to young people after they leave high school 
and ,\o relate this information to their prior educational 
•experiences and their personal and biographical charac- 
teristics. Ultimately, the study will lead to a belter 



understanding of the development of student* as they 
pass through the American cducationul system and of 
the complex factors ayocijted with individual educa- 
tional and career omcomes. Such Information is 
essential as a basis for effective planning, implementa- 
tion, .and evaluation of Federal policies and programs 
designed to enhance educational opportunities and 
achievements and to upgrade occupational attainments 
and career outcomes, 

3. T» Provide a Data Base 

The major NLS objectives are to provide a data 
base for policy decisions that may guide Federal 
contributions through the Nation's educational system 
to the fullest development of human, and material . 
resources, and to provide social scientists and scholars £ ' 
with a rapidly enriching data base that no. one of them r 
could afford but all can use in pursuit of professional 
interests. The data base ftself , as it now exists and as it 
is updated, will be available to interested researchers 
for their own studies. 

4. To Disseminate Information 

Summaries and analyses of data aye being written 
up in periodic reports to be issued by HfcW and made t 
available to the educational . community. Reports 
focused on single issues targeted for specific groups will 
be designed for rapid dissemination. / 

DT, Objectives of the First Followup 

The 1973-74 -first followup survey included data 
collection, data transformation, preliminary data analy- 
sis and interpretation, and the making of survey - 
recommendations for the 1974-75 second followup. 
The overall *aim of these activities was to satisfy^ jfce 
tyoad, long-range NLS objectives: 

1. To assess the demands for postsecondary educa- 
tion, including>adtilt, vocational, and tethnical; 
the characteristics of students going on; where 
they go; the factors inhibiting the realization of 
educational aspirations; and the characteristics of 

* and alternatives pursued by those who do not go 
on. 

2. To determine what type* of students make what 
educational and/or occupational choices- for the 
purpose of establishing " meaningful flow data. 
Understanding the chain of decisions that shape 
an individual's/education, training, and launching 



of a career, and establishing the relationships 

needed for predictions. 

•x 

} To develop means for assessing how educational 
experiences, personal influences, and social atti* 
hides have led the graduate to the point at which 
lie finds himself, and for evaluating the extent to 
which these arc related to his decision* about 
occupational choice, military service, and voca- 
tional, technical, and higher education. , 

4. To determine the extent to which students are 
aware of postsecondary education an<j employ* 
ment alternatives and the options stiH open ttf 
them , how th^sf were influenced by counseling; 
to wjiat extent institutional and federally funded • 
recruiting projects affect postsecondary school 

■ choices; how employment opportunities "can 
influence tfiese choices; and to what extent the 
lack of information about postsecondary oppor- 
tunities (either education oj occupational) limits 
their aspirations. 

5. To determine the influence df student ability on 
postsecondary choices jind to J associate the 

* choices with test scores, the student's perception 
of his own abilities, and his class standing. 

\ * ' '* ' 

6. To' relate low-aspirati&n choices f<$#-^post~ 

secondary education to the principal obstacles * 
perceived by the student, especially financial 
obstacles, and to determine profiles* of the 
student's knowle4ge of programs of financial aid, 
their applicability to his , situation, and his 
intention to take advantage of them. 

7. To follow the educational progress of students 
and* those terminating early .to see how high . 
school experiences, curriculum patterns, and 
financial and other factors are associated with 
postseebndary career choices and perseverance 
and success in them, and to identify the factors 
associated with "dropping out'* and changing 
jobs after different intervals. 

&. To identify, from the jrtJfcflrt study, subpopula- 
tions such as high achievers with limited financial 
resources,- disadvantaged minority groups, and 
students in junior colleges and vocational arid 
technical schools, and to investigate interactions 
and influences between and among individuals 
2 that will shape their futures. 



9/ To refine the means and methods of assembling, 
merging, and maintaining (data on large, diverse 
samples of Jiighly mobile populations and to 
relate these techniques^to* other fields* 

10/ To investigate the consistency of patterns ap- 



m parent in the analysis of base-year .data, identify 
* new patterns and/or changes in established .pat- 
terns for further investigative emphasis, and 
define areas for emphasis in subsequent follow- 
ups/ - "\ 



1 Chapter II 

SAMPLE DESIGN AND SURVEY PARTICIPATION 



A. Basic Design * 

All eligible 1971 12th-graders enrolled in all public, 
private, and church-affiliated high schools in the 4 50 
States and the District of Columbia made up the 
population to 6e sampled for the NLS base year. The 
survey plan for selecting from geographical areas was a 
deeply, stratified two.-stage probability sample -design 
with schools as first-stage sampling units and students 
as second-stage u$&. The sample was designed and 
selected by WESTATi Inc. 1 

The school sampling frame, constituted from ccy^jjt 
puterized school files maintained by OE and b)$She 
National Catholic Education Association, was stratified 
into 600 final strata based on the following variables: 

- Type of control (public or nonpublic); 

- Geographic region (Northeast, North Central, 
South, and West); . ' • 

^ Grade 12 enrollment (< 300; 300-599; >660); 

- Proximity to institutions of higher learning (3 
levels); . ' * 

- Percentage minority group enrollment* (8 levels); 

- Income level and type of community (2 types); 
and ' ■ v 

—/Degree of urbanization (10 levels). 

Schools in low^income communities and schools 
with high proportions of minority group enrollments 
were 7 selected and assigned probabilities twice as large 
as those used for the other schools to increase the 
numbers of disadvantaged students in the sample. 
Schools in the smallest grade enrollment stratum 
(<300 seniors) were-ifekcted with probabilities propor- 
tional to their esfmiated . numbers of seniors and 
without replacement; schools in the remaining grade 12 
euroUment strata were selected with equal probabilities 



and without replacement. Within each of the 600^ 
-strata, 4 schools were selected; then 2 of the 4,were 
designated as tl\e.prirnary selections (2 x 600= 1,200) 
and the other 2 were retained as backups (1 ,200) to be 
-used in the sample if one or both of 'the primary 
schools did not cooperate (e.g„ refused, were ineligi- 
ble). From each school, 18 shfdelfl? and 5 alternate 
students were sampled with equal probabilities and 
without replacement. 

B. Base- Year Participation, 1972 

* ■„••*• 
The sample design involved 1,200 primary sample 
chools and a target sample of 21 ,600 students (18 per , 
sfifeool). The task of- collecting base-year data was 
contracted by NfcES to Educational Testing Service 
(ETS) of Princeton, New Jersey. 2 .Gf the 1,200 
schools, 948 participated, 21 had no senior students 
^enrolled, and 231* either refuseM to or could not 
participate because the request was received too late in 
the school year (table 2-1). A participating school was 
defined as one in which at least one Student Question- 
naire, Test Book, or Student Record Information Form 
(SRlfywas completed. ' , v 

r • " * • " . " 

table 2-1 .-Base-year school participation data 



1 

Sample schools - 


Primary .sample 
schools 


Participating 
schools 




Number 


Percent 


Number 


Percent 


Total 4 „ 


1,200 


100.0 


1,070' 


100.0 


Primary sample 
Participants 
No»senior students 
Nonparticipants 


948 
21 
231 


. 79.0 
1.8 
19.2 


948 


88.7 


Backup sample ■ 
"Extra" in base year 
Other participants 




* > 


26 
96 


2.4- 
B.9 



WEST AT, Inc. ,1972. Sample Design for the Selection of a 
Sample of Schools V$fc Twelfth-Graders for a Longitudinal 
Study. Rockville, Maryland. 



2 Educational. Testing Service. 1973. The Base-Year Survey 
of the Na tional Longitudinal Study of the High School Class of 
1972- Final Report. Princeton, N«w Jersey. 



Backup schools were also established as a part of the 
sample design as repfaceifients for nonparticipating 
primary sample schools. In the bajfe year, 122 backup 
schools participated; 26 of theses were termed "extra*' 
because both primary samgje schools from that 
stratum also participated. Ir/the 1972 survey, there 
were 1 ,070 participating schools. 

Within the 1,070 schools, 19,144 students were 
sampled; these include^uie 18 eligible studefits per 
school and ttye alternates used to replace noneligibles. 
Of the 19,144, 95 percent participated (table 2-2) by- 
having available one or more completed survey instru- 
ments. The average was 17 participants and 1 non- 
participant per school, 

c - 

; • . / 

.'' Table 2r2.-Base-year student participation data 



— — ^ — 1 

Sanipl^tudents 

w 


Number of students in 1 ,070 schools 


Total 


Average per school 


Percent 




19,144 . 


17.91 


100.0 


/ 








participants ; 


18,143 


16.97 


94.8 


Nonparticipants 


1,001 


0.94 


5.2 



Response rates (table 2-3) varied by insjrument- 
SRIF's were completed by 95 percent of the 19,144 
sample students, Student Questionnaires by 87 per- 
cent, and Test Books by 83 percent. Lx)okirjg at.the> 
response rates another way^SRlF's were filled out for 
all but 3i of the 18,143 participating students-nearly 
a 100 percent response-arid Student Questionnaires 
and Test Bopks were completed by 92 percent and 87 
percent. > 

Table 2^3 .-Base-year student response rates 





Number 


Percent of 


Percent of 


Survey, instrument 


com* 


sample 


participating 




pleted 


students* 

« 


students** 


SRIF 


18,1 10 


94.6 


99.8 


Student Questionnaire 


16,683 


87.1 


92.0 


Test Book 


15,863 


82.9 : 


87.4 , 



•1.9,1 44 in 1 ,070 participating schools. ^ * 
♦♦18,143 in f,070 participating schools., 



TTi^ School Questionnaire was completed by 97 
percent (1,038) of the participating schools; the 
Counselor Questionnaire was completed by 1,804 
counselors in 1 ,040 schools, \ 



C. Resurvey Plans ;J ' ' v - . 

Due to the lafge school non response in 1972,|it was ' 
necessary to 'elicit responses from the 23 1 nonparties ^ 
pating primary schools and replacements for the 21 
schools that had no seniors. The initial "resurvey" 
activity conducted in 1lhe summer of 1973 before the 
first followup survey of October 1973-involved secur- 
ing school cooperation and selecting random samples 
of up to 18 students (1972 seniors) per school. RT I's 
basic responsibilities we&e to: 

1. Collect School Questionnaire data from each 
resurvey school; 

2. Collect SRIF data on individuals selected from 
each resurvey school, secure permission to obtain 
the same SRIF data from individuals selected for 
resurvey; 

3. Collect short Base-Year Questionnaire data from 
those individuals selected from each resurvey 
school; . • 

4. Update the base-year data base and produce 
* weights to incorporate. the additional data. 

The information gathering was limited to relatively 
hard data rather than data on attitudes, plans, and 
perceptions likely to change substantially over time. . 

D. Resurvey Participation, 1973-74 

In the summer, of 1973 when NCES contapted the - 
231 sample schools that had* not participated in the 
baser-year survey, most of them (205) provided the 
latest names and addresses of up to 18 of their 1972 
seniors .selected by simple random sampling. Former 
19?2 senior students^ were also selected from 16 
augmentation sample schools (in 200 school districts, - 
eligible public schools not included in the base-year 
sampling frame). Thus 4315 former students were 
added from 257 participating resurvey schools-205 
primary sample, 36 backup sample, and 16 augmenta- 
tion sample schools. 

A newsletter developed by RT\ was mailed in July 
1973 not only to,encourage participation but also to 
update names and addresses. When mail was returned 
by the U.S. postal service as undeliverable, telephone 
tracing procfedures were used to obtain current ad- 
dresses. Table 2-4 shows ihe response rates of the 
resurvey group. The individual response rate to Form B 
was acceptably high; however/school cooperation in 
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• * '/ completing School Questionnaires and providing 
V SRiF's' proved difficult to" obtain. SRIF's were re- 
quested from schools only for those resurvey individ- 
i \ iials wjtib gave permission for the data to be used. 

\- Table ,2-4.~Resuryey student response rates 



Survey instrument 


Number 
completed 


Number 
in sample 


Percent 
participating 


Form B. Questionnaire* 


4,061 


\ 4,315 


94.1 


School Questionnaire 


202 


257 • 


78.6 


SRIF Use Permission 


3,467 ♦.♦ 


4,315 


80.3 



♦With base-year background data. -: 
♦♦Include! 880 SRIF's received after 'cutoff date of first 
release tape. .**■' 



E. First Followup Participation, 1973-74 

Table 2-5 shows the numbers of schools 'participat- 
ing in the base year, the. resurvey, arid the first; 

tllowup. Not included in the first followup were 26 
hools termed "extra" in the. base year. Due to the 
resurvey, 1,153 oj^j|ggrcent of "the 1,200 primary 



sample schools did' participate. With the backup and 
the augmentation .sample, the first followup participa- 
tion was 1360 schools. 

Table 2-5.-Number of participating schools, by survey 



" m . School sample 


The 
base-year 
survey 


The 
.resurvey 
, effort 


First 
followup 
survey 


Total 


1,070 


257 


1,300* 


'Primary sample 


948 


205 


,1,153 


Backup sample 
"Extra" in base year 
Other , 


. 95 

"... 


36 ' 


131 ' 


Augmentation sample 




16 


"... 16 V 



♦The 26 extra schools were not included In the first followup. 

Table 2-$ shows the composition of the first 
followup sarftple membership. Included in the fin§I 
NLS sample of 23,451 are 19,136* ha^-y ear partici- 
pants and 4,315 resurvey members. Base-year extras 
not surveyed in the first followup, removals from the 
file, and participants with bad addresses, etc., yielded a 
final followup mailout sample of 22,654. 



able 2-6.-£omposition of first followup sample membership 



A. Received 1 from prior contractor , 
Base-year' respondents from: - * 

Primary sample schools * 

With Student Questionnaires 16,301 

Without Student Questionnaires '2,201 

Backup sample schools 

v With Student Questionnaires 382 

Without Student Questionnaires 117 

Other schools '"'■«■ * 

Without Student Questionnaires " 135 

" ' Total sample received a 

Duplicate and ineligible! records (later removed) > 

Total records received 

B. Resurvey samp fe « ' 

Original sample school members 
Augmentation sample school members 

Total resurvey sample \ 

C. Total NLS sample 

D. Presurvey removals 

\ Base-year extras 
Refusals 
Deceased 

Transfers or dropouts prior to graduation 
Miscellaneous (EMR, out of country, etc.) 
Incomplete or garbled addresses, untraceable, etc. 

Total removals 

E. Total first first followup' mailout \ 



16 



18,502 
499 

135 

19,136 

lA 

19,144 



4,047 
268 



- 472 

- 34 

- 5 

- 21 

- 9 

- 256 



19,136 



4315 
23,451 



- 797 
22,654 



8' 
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Chapter III 

DEVELOPMENT OF THE FIRST FOLLOWUP QUESTIONNAIRES 



A. Modifying a Model . 

One early effort irl planning for the NLS was a , 
forge -scale literature review and analysis. 1 Selected 
major longitudinal studies of student and nonstudent 
populations were analyzed, to discover variables, tech- 
niques, ' methodologies, : and problems pertinent to 
evaluations of the effects of schools and colleges on 
children and young adults between the ages of 14 and 
30. 

One product of this effort was the* conceptualized 
, General \Educatidnal Development Model depicted in 
figure 3-i\ This model was used in the* planning for the 
\ First Followup Questionnaire; it was later modified to 
include the Base-Year Studen t Questionnaire. 

The modification excludes some classes of variables 
(e.g., psychological climate and socialization in the 
home) since, they were not considered amenable^to 
"adequate measurement. Other classes (e.g., personal, 
\ intellectual, and educational satisfactions) explicitly 
\included in the original model were later considered to 
ie best measured in future followups. Others were 
conibined; for example, goal orientation in the original 
model encompasses expectations and aspirations in the 
late/ model. ."Still, others (e.g., community environment) 
not explicitly included in the first model became key 
to the later model. Thfe'modi fie d model is shown as 
figure 3-2. * ^ 

B. Defining the Questionnaire Objectives 

The questionnaire was designed to meet the primary 
analytical objectives of the first followup survey by 
pkovidirig continuity^ over time-in measurements of 
educatic^al^ocationa^j^fans Si the ~base : year. re- 
spondents. A programmatic objective "was to identify 



1 James W. Trent, Claire Rose, Ann Salyard, Judd Adams, 
Alfred C Marcus, J. Ward Keesfing, and Arthur Getft 1972. 
An Analytical Review of Longitudinal and Related Studies as 
They Apply to the Educational Process. Los Angeles: Center 
for the Study of Evaluation^ UCLA. 



sociocultural variables which may have had impacts or! 
19*72-73 educational-occupational decisions, In view of 
these two broad objectives, questionnaire items were 
designed to describe the flow pattern, between an 
individual's activity statuses in October 1972 and* 
October' 1973 and the future plans, aspiration^ 
opinions, and attitudes relevant to educational-voca- 
tional outcomes. To guide item selection and.revisiori, 
10 questionnaire objectives Were defined. 

OBJECTIVE 1 -To document the activity statuses 
and programs in October 1972 and October 1973. 

Student activities and progress :in 1972-73 were 
'I deterrinined by requesting information beyond that 
' asked for in item I: "What are you doing now?" . 
Groups of items follow: • •■!••« 

EDUCATIONAL STATUS ; r k 

School attendance ' 
Educational and training programs since high school 
Pbstsecondary school attended since high school. 
Classes or courses in October 1973,- - - 
Classes or courses in October 1972 
Other school attended since high school 
Current attendance at other school 

Institution type 

Name, location, and type of school in October 1973 
Name "location, and type of school in October 1972 
Name, location, and type of o^ier school 

; •■ 'J 

Program type 

^Type of educational or training program* - 
Field of study or training in Octpber 1973 ' - 
Field of study or training in October 1972 



\ 



Program completion 
' Completion of educational or training program 
Grades 



Figure 3-1. -General educational development model 
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„ Figure 3-2.~Concaptual model of tt» NLS 
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e.g., SAT 8, AC I 
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come, parent's 
education* pVept's 
occupation 35 



HOME ENVIRON. 
ME NT 

e.g., no. at siblings 
in college, object* . 
in home 32 



SECONDARY 
SCHOOL CHAR- 
ACTERISTICS 
■ e.g., mm of Khool', 
(ntiruc lortrudent 
ratxx ability groupini 
or tucking. 25,29 



SCHOOL EXPERI- 
ENCES e.g., pro- 
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i\ and special pro- 
grams 19 
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'Pro&amxompletion-Continued. 
Credits earned 
'Certificate > degree , or license working toward 
Certificate, degree, or license earned " 



ties; arid personal characteristics^uch as ability ,jfex, ' jk 
age, and physical handicaps. 



EMPLOYMENT STATUS 
1973 and \ 1972 

Working in October ' ■ , » * ^ 

Reasons not working in October , 

Looking for work in September 

Job descri^iota in October ^ 

Hours worK&dtper week in October 

Earnings per week in October 

Other jobs in October f - 

^ MILITARY STATUS . 

Current statu*' % 
"Branch of Armed Forces 

Enlisted or drafted 

Date began active duty 

Specialized schooling * 
* f/pe of program # 

Pay grade and specialty rating 

Courses taken 
' Active duty or date left 
» ' ■- • ■ 

-MARITAL STATUS <+ 

Marital status 
Marriage date 

OBJECTIVE 2-To identify background factors 
associated with postsecondary school choices and 
career paths and persistence in those choices and 
paths. 

Background factors (input variables) considered to 
be important predic.tors of postsecondary school 
choices and career paths were measured in the Base- 
Year Questionnaires. Most of them did not need to be 
repeated; however, the first followup survey was to 
include about 4300 individuals not surveyed in the 
base year (the refcurvey members, for whom an 
augmented form of the questionnaire was prepared). 
Additional base-year questions on this augmented form 
included socioecpnpmic status and home environment; 
race or ethnicity; religion; community characteristics; 
influences of significant others such as peers, parents, 
and school personnel; high school program and activi- 



OBJE CTIVE 3-To id entify contemporaneous vari- 
ables associated , with persistence and changes in 
plans in spring of 1972.. and activity statuses in 
October 1972 and October 1973. ... 

The purpose' was to estimate the effects ofcontem- 
poraneous events-thbse intervening ^vents' occurring- 
.after a student leases high school-upon persistence in 
'activity statuses between October 1972 and October 
197,3. (As a rule, it is necessary to cortjiof key 
background variables such as socioeconomic status in 
order - to assess the effects of postsecondary school 
' variables.) Variables which research has suggested may 
be important for facilitating or inhibiting a students 
progress after leaving high school are: ' ' ~- 

Economic factors are measured by items 9 and 10 
oh the contemporaneous , financial independence 
and responsibilities of the individual's parents and 
himself, item 11 oh individual's arid spouses' in-, 
comes, items 46 and 47 on costs of and sources for 
paying for education. 

School experiences are measured by items 24 and 
29b on reasons for not continuing education; items 
81-84 on the college applications; items 27a, 33a, 
and 40c on matriculation dates; items 27b and 33b 
on full- versus part-time status; item 31 on reasons 
for changing schools; item 38 on reasons for 
withdrawing from school; items 22, 28, and Jo on v 
fields of study; items 34 and 35 on changing fields; 
. item 44 ort participation in special services pro- 
grams. . . . • 

Work experiences are measured by items 48b .and* 
54b cfri reasons not working, itefff 51 on job 
satisfaction, item 59 on methods used in looking for 
work, items 62 and 63 ori *he relatedness of high 
school vocational training arjd subsequent work 
experience. 

Marriage and family planning"*** measured by item 
7 on marital status; iterins 8: 17, and 18 on fertility 
behavior and plans; itertls 24, 29b, 48b, and 54b on 
marriage (homema)cir^( as a reason for not working 
or going to school. . . / 
r ' , .'. / A* ' 

Community characteristics are measured by item 6b 
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on migrations, itertis 4 and 5 on people lived with 
and type of residence, item 6a on Locatiori (suburb, 
* farm, city, etc.);- % 

Psychological traits are measured by item 15 on 
self-concept and control of environment, item 13 on 
willingness to borrow money for education . 

. - > • . 1 

Influences .are measured by items 77 ai)d m on 
. encouragement", discouragement, and helpfulness of 
significant others in making vocational-educational 
decisions. 

OBJECTIVE 4-To measure shifts in general and 
specific life goals in short- and long-range planning 

Plans or aspiration^ are not always congruent' with 
the states in "-which 'individuals fimj themselves at'any 
given point in time, Thus, in October 1973, we wanted 
to know their current plans and futiire.goals. Changes 
-in ajalsSnce they were seniors were examined to sdfe if 
the; changes were in a direction consistent with 
educational-vocational qualifications and/or experi- 
ences. To maintain comparability, the majority of 
items measuring aspirations in the First Followup 
Questionnaire were repeats of items in the Base-Year 
(B-Y) Student Questionnaire. 

Item 20 measures life goals (as did B Y item 20); 
items 12 and 14 measure educational aspirations 
and expectation* (same as B-Y (item 29); iteni 19' 
identifies the kind of work they expect to be doing 
.when they are 30 '"(revision of B-Y item 25); items 
75 and 76. measure plans" for military service; and 
items 7a, 17, and 18 deal with marital and child- 
bearing plans important to predicting educational- 
vocational outcomes 3f men and wopien. "V 

OBJECTIVE 5 - To estimate, the effects of institu- 
tional and federally financed programs on aspira- 
tions and persistence in career programs. „. « 

Some items' > help -identify , the level -of special 
assistance needs of students with handicaps and refer 
to the uses that students make of different programs. 

Items 24 and 29b deal with reasons tor not contin- 
uing education, items 31 and 35 concern reasons 
for changing school and field of study, and items 
. 48b and 54 concern reasons for not working and 
identify students in need pf assistance. Individuals 



who have received special assistance or have used 
institutional resources finay be identified by item 85 
on helpfulness of high school counseling programs; 
items 82d, 83<Lp and 84d deal with offers L of 

• a financial aid (qt continuing education; item 47 
concerns sources for paying school and college ex- 

- penses; item 44 measures participation in special 
services programs; item 22a deals with on-the-job 
training and other manpower programs; item 59 

; Concerns the usas of agencies in finding work; and 
litems 72 and 76' deal with uses of the GI bill in 
making educational plans. • t 

OBJECTIVE 6-To identify subgroups* of potential 
interest for special analysis.' ^ 

The measures^ required for special analyses of 
♦postsecondary school dropouts (e.p., those of high 
ability and disadvantaged minority groups), are cqyered 
by items in thpVStucient Questionnaire or by items 
mentioned under the above objectives. 

OBJECTIVE 7- To measure short-term progress 
with respect to' the relative effectiveness of high 
school and postsecondary vocational and on-the-job 
training. 

Whereas many individuals who continued their 
education after leaving high school will noT"have 
completed their program of studies, some students who 
have received career training will not he in the work 
force. ^ 

The short-term effects of career training are assessed 
by item 50b on earnings per week and by item 51 
on job satisfaction. Items 22 and 43 describe 
programs completed and certificates earned in post- 
secondary vocational, business, or trade schools; 
items 6L, 62, and 63 assess the utility of high school 
vocational training programs. 

OBJECTIVE 8-To assess the influence of the high 
school "environment"-as reflected by the variance 
in ability and socioeconomic background of jhe 
students in a school-on the progress of subgroups 
in different activity statuses. , 



This objective may be fulfilledXby using the 
measures of progress outlined under objectives^. Hems 
used as predictors and as the bases for clarifying 
selected subgroups' of special interest wili^be taken 
from the Base-Year Student and School Questionnaire. 
. 'I 4 



OBJECTIVE V To define areas for concentration in 
subsequent folhwups in order to assess the effects 
of education on nonvocational and nonacademic 
outcomes, - including cognitive and non.cognitive 
measures. • 

While conventional measures such as employment 
status and income Will be used in later analyses to 
distinguish the "successful" from the "unsuccessful" 
.students, education may have other significant out- 
comes that' often are overlooked. Thus the cognitive 
traits ''self-esteem" arrtl "locus of control" (item 15) 
^jnd life goals (item 20) were repeated fror 
Student Questionnaire. . 



OBJECTIVE 10-To develop a followup question- 
naire for assembling, merging, and maintaining data , 
oft a large sample of a highly mobile population and 
to develop the means for clearly defining the target 
population at any point in time, 

; T^e timing of events was critical in the followup 
since . questionnaires would be administered to re- 
spondent^ over a 2- to 6-month period. To provide' a 
common reference date for the entire sample, Jmost 
recent events/ are linked to the 'October- 1973 date. 
However, sincp, psychological traits such as "attitudes" 
can be measured only contemporaneously (as many as 
6 months after October), it will be important to know 
if any majpr diange has occurred in activity statuses in 
the interim: Item 1 ("What are you doimj nowV), 
items 22c, 28c, and 36c on program length; item 22H 
on* program completion; and ite>ns 49g and 55g on 
current work sWtus detect sii£h changes. 

C. Field Testing and Revising 
the Initia) Version 

Between the base -year data collection in June 1972 
and the start of the first followup in October 1973, the 
Bureau of the Census fiel(i tested the initial version of a 
full-scale questionnaire approved by the Office of 
Management and Budget qs No. 41-S-730O4. This 
questionnaire was administered during March-May 
1973 to 903 high school seniors from the class of 
1971 -the same sample selected and used in 1971 to 
design the base-year survey. 8 

The field-tested questionnaire was to be used in the* 
first followup to ascertain the educational and work 
statuses of the 1972 school seniors for October 1972 
and October 1973 and to obtain data.on self-concept, 
locus of control, aspirations, expectations, plans, goals, 



and work and educational experiences. It was the basis 
for item revisions and additions which were outgrowths 
of the application to it of the conceptual models. After 
6 weeks of conferences, staff meetings, and draft 
working papers, the final form of the 'First* Followup 
Questionnaire was approved in September 1973. 

The field-tested instrument contained 63 items. The 
final form contained 851 The latter instrument was 
longer because- * 

1. Time references over the relativity" long period 
(October 1973-March^974) for collecting data 
on r educational and work activities were ad- 
dressed to two points in time, October 1972 and 
the first week of Octooer 1973. (The field test 
version concentrated primarily on the re-. 

>spondent's current a«;iyit^?) v 

2. New areas thought to be of sufficient importance 
* to be included in the new instrument were 

fertility behavior and plans, lrte^goals, school 
progress, noncollege education and training pro- 
grams, and financial independence. . ^ 

3. Some'old question's (e.g., those involving college 
choice) had to be expanded in scope to obtairt 
the data to answer Questions of interest. 

4. Father's education and occupation were added to 
the followup instruments. Many of the proposed 
fitst followup analyses were to involve work and 
educational path/of subpopulations defined in 
part by 'family Socioeconomic status, and there 
was substantial nonreaponse to these items in the 
base-year survey. 

5. Certain base-year questions needed to be asked ^ 
of first followup respondents who had not or 
who had partially participated in 1 972 (provided 
some data but did not complete a Student 
Questionnaire). Plans were being made to recon- 
tact nbn participant schools and to select about 
4,450 students. Both groups would need retro- 
spective base-year questions; Forms A and B of 
the r First Followup Questionnaire were de- 
veloped . 

D. Grouping the Items 

Form A of the First Followup Questionnaire is an 
85-item, 24-page booklet for self-administration by the 
respondent, Most of the base-year and first followup 
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question* arc of the fixed-choice (closed-response) 
types. Open-response questions were limited to dates, 
income, number oTJijours or weeks worked, and the 
like. All questions were constructed and formatted by 
specialists in instrument design. * 
v Form B of the questionnaire was designed for par* 
ticipants from whom selected base-year data Were 
needed. Identical to Form A^through 85 items and 
24 ' pages, Form B continues for 14 items (86-99) 
in section E,.-whjch, concerns high school program, 
activities, and y, plans; family information: and 
personal demographic information. Form B* also con* 
tains a signature block on' the .inside front cover for 
permission to use school records.. Table 3-1 indicates 
* the^first followup anid base year equivalents for these 
14 items. 

Forms A and B are divided into six sections: general 
information, education and training, civilian work 
experience, military service, information about the. 
past, and background information; 

Table 3-1.-Flrst Followup and Base-Year Questionnaire 



^numbers* 




< 


First Fojtowup (Form B) 




Base-year 


i *■ 86 




2 






5 


88 




8 


89A tiirough 89! 




10A through 101 


90 




27 


91 




16 


92A and 92B 




91 A and 91B 


93 




93 


94 A through $4 K 




94A through 94K 


95 




84 


96 




88 






92 


* 98 




95 


99 




* 83 



1. Section A-Generai Information 



Section A contains questions about present- 
activity-statuses (1); high school status (2,3); present 
community and home characteristics (4,5,6); present 
marital status and fertility (7,8); present financial 
dependence and income (9,10,1 1); educational aspira- 
tions and expectations, including financial plans 
(12,13,14); self-concept and locus of control (15); 
expected future activity statuses, including plans for 
chiWbearing (16,17,18,19); and goal orientations '(20). 

The marital status and fertility questions can be 
especially useful in explaining the career patterns of 



men and women. Self-concept, locus of contr&l, life * 
goal orientations, Educational expectations and plans 
were also measured in the base^ear; thus the absolute 
values of and the changes in these for the two time 
points can be hypothesized to moderate .the condi- 
tional probabilities, of leaving cjne plan or activity state 
for another. 

2f Section B- Education and Training 

9 

. Section B contains questions about nonschool, 
nonmilitary training programs (2f^2vQ; formal post- 
, seoandary education (23); reasons forgot continuing 
fownal education (24 lt 29b); 1973 Educational status 
(25,27)^characteristics of school attending (26); 1973 
field of study or training (28); 1972 educational status, 
(29a,33); transferring and withdrawing (30,3 1 ,37,38);' 
characteristics of school attended in 1972 (32); change 
in field of study or training (34,35); 1972 field oT 
study or training (36); attendance at other schools 
(39,40); school progress (41,42,43); special services 
(44); satisfactions with education and training (45); 
and schooling or training finances (46,47). - 

The questions in this section were designed 
primarily for defining postsecondary educational and 
training activity statuses which ^/e to be used as 
outcomes in the descriptive, predictive, and causal- 
modeling analyses. " c 

3. Section C-Civilian Work Experience 

Section *C contains questions about present em- 
ployment status (48a,48c); reasons for not working 
(48b); characteristics of present job (49,50); satisfac- 
tion with that job (51); work expectations for 1974 
(52); other jobs in 1973 (53); employment status- in 
1972 (54a,54c); reason* foi . not working in 1972 
(54b); characteristics of 1 972 job (55,56); other jobs in 
1972 (57); summary of jobs and' weeks worked, 
October 1972 to October 1973 >5&)r*rfiethods of 
looking for work (59); and employment using high 
school training (60,61 ,62,63). 

The questions Jn this section were designed fur 
defining work activity statuses which are to be used as 
outcomes in descriptive, predictive, and causal- 
modeling analyses. 

4. Section D-Military Service 

t : 

1 Section D contains questions about branch and 
status of military service (64,65,66,67,74), specialized 
schooling (68,69,71), pay grade arul specialty rating 
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"(70), plans to jiise the GI bill (72). satisfaction with the 
military service (73), military career'plans (75* and 
poatmilitary career plans (76). . ~ / 

The questions in this section are used ^define 
military activity status'in descriptive, predictive, art4 
causal-modeling analyses. 

•/ • • . • ■ . . .% * 

5. Section E-Informadon About the Past 

Section E contains questions about influences of 
parents and friends on posfogondary activities (77); 
parental educational levels (78); father's occupation 
(79); mothens employment status (80); prior applica- 
tion, accept&nde, arid financial aid at first -choice school 
or college (8i\82); secpnd-choice and third-choice 
schools or collages (83,84); and helpfulness of high 
school counseling services (85). 

Sjftion E of Form B contains 14 additional 
items (86-99) which were discussed in this chapter. 
* ./ 9 

6. Section F- Background Infonnatioo 

The inside back pages of Forms A and B contain 
section F, which asks for the names, addresses, and 
telephoneSnumbers of the respondent, respondent's 
parents, arid two other persons; and the date of birth, 
social security number, and driver's license number of 
the respondent. This information is used in tracing 
activities for subsequent followup surveys. 

Jg. Selecting the Key-Response Items 

Many considerations went into deciding whether a 
returned questionnaire contained adequate information 
for acceptance, editing, and entry into the data file. 
The general requirement was to obtain* a pertain 
required minimum of data on respondent activities 
since, leaving high school, rather than complete ddta on 
all items. The! following items were designated as 
crucial to the acceptability of the questionnaire: 

General Information 

1 What are you doing now 1 . 
16 What do you expect to be doing in October 
19741 ' ' < 



Education ahtf Training 
21 Since high school, any training programs? If 
' "y e *»" 22a should be completed, (The response 
to 21 can ^presumed if 22a is completed.) 
. 23 Since high .school, an y colleges or universities? 
- If 25 should, be answered. If 25' is 

"yes* 26a and 26b Should be answered, \ 
29a Any classes or courses In October 1972? If 
t4 yes," 30 should 'be answeftd. If 30 is k W 
32a should be answered . 
37 Withdraw (torn school prior to completion? If 
34 i^ho," 37 should be completed: 
* • * 
Civilian Work Experience 

48avHolding a job in October 19731 If %k yes" 

49a l ,b,c,d should be answered. 
54a Holding a job in October 19721 If kk y« " 

(different job), 5a,b,c,d shoulfi be answered. 
58 1972-73 work history. Section A of 58 should 

be completed. 

Military Service 

64 Served in Armed Forces? 

Information About the Past (Form B) 
95 Ethnicity 

Background Information ~v 
Names, addresses, and telephone numbers of re- 
spondent and his parents. Date of birth, sex, and 
♦social security number^ for Form B respondents. 
Signature permission fdj Form B respondents. 

Immediately after receipt and check-in of a mail- 
returned questionnaire, it was. routed to a manual 
pre-machine edit section where responses to the above 
key items weje verified for presence and consistency, 
((^ost restraints and questionnaire complexity limited 
the editing to these items.) Failures were noted oh an . 
Edit Proolem Sheet, which was* routed with the 
questionnaire to the Telephone Tracing Department. 
The respondent \was telephoned if possible so that 
inconsistencies could be clarified or corrected and 
missing-data could be supplied. ' 4 
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Chapter IV » 
MAXIMIZING PARTICIPATION AND RESPONSE 



The NLS population is young, highly, mobile, and 
involved* in decisions about future work, and life 
patterns. Continued participation in NLS depends 
largely on success in keeping in touch with, motivating, 
and developing rapport with individuals in the survey 
population. Methods used to enhance the willingness 
and to increase the response included newsletters, 
thank -you letters, mailgrams, reminder post cards, and 
wallet-sized cards showing NLS, involvement and serv- 
ing as change -of-address cards. Several recommenda- 
tions for maintaining cooperation and improving re- 
sponse were outgrowths of tlje first foliowup survey; 
these recommendations are given in section H of this 
chapter. 

Response to the mail questionnaire will become 
more crucial and cosily each year with each survey. 
For this first foliowup, the letter, post card, and 
telephone contacts were designed to produce amail 
respQnse rate of 60 percent, wfthin resource and cost 
considerations. The remaining 40 percent were to be 
individually interviewed by Census Bureau* field 
personnel. 

A. Newsletters 

In July 1973^ RTI.sent newsletters fp base-year 
participants. Slightly modified newsletters were mailed 
tQ "resurvey" members in September I^3> The first 
newsletters "reviewed the purpose of NLS, described 
student participation leyeR, announced that the first 
foliowup survey waVunderway, seated that a question- 
naire would b^ mailed, stressed the importance of 
continued participation, an<J. requested that Xhe re- 
spondent return ah enclosed- card verifying current 
address or showing the needed corrections. Before the 
major, mailout of ^the First Foliowup Questionnaire, 
resUrvey members were mailed a revised version of the 
newsletter; it explained the srMdy ^elicited cooperation, 
and requested permission to use School record informa- 
tion to be collected from resurvey school*. Mailed in 
1973 wer*23,560nwdetters: 'V • * 



16,650 on July 27,30,31 ^ ^ 

400 on August 21 '* 
3,408 on September 26 
3,102 on October 8, 9 - 

mefits of a newsletter were valuable Jeadtime in 
locating respondents for whom addresses had changed 
and being able to update the addresses prior to the 
questionnaire mailout. r , ... • 

B. Trating Activities 

About 90 percent of the more than 2,0 
fronfrthe base-year and the resurvey efforts 1 
by telephone (table 4-1). Mail was used 
parents, and others who did not have teli 
for some colleges and State motor vehicle d* 
Of the unsuccessful cases, 14 were sent to a lc 
bureau; the bureau was unable to obtain 
addresses for these. . % 

In the Base-Year Student Questionnaire were ,je-' 
quests for the student's name, address, social security 
number, and driver's license number;. w,e name of the 
postsecondary educational institution the student 
planned to attend; and the names and addresses of two 
people who would always knowiwhere to get in toi^ch 
with the respondent. Similar tracing information was 
requested in section F of the First Foliowup Question- 
naire. 

Table 4-1;-Telephone tracing cases, 1973-74 






' Cases 


Reason for tracing 


Traced 


Completed 


Unsuccessful 




Numbcrj Percent 


Number 


Percent 



Total 



Newsletter unde- 



'2,067 1,890* 



177 



'liverable 1,565 .1,493 95.4 ,72 4.6 

Questionnaire unde- 
liverable 502 397 79.1 105 20.9 



Earfy in August of 1973, tracing to.prepare for the 
first followiip began as the postal service returned 
un deliverable newsletters; it continued through Janu- 
ary 1074 as undeliverable Questionnaires were re- 
turned; Information types and sources were: 

1. Names,- addresses t and telephones of parents, 
guardians, or relatives. 

2. Names, addresses, and telephones of two people . 

1 who would always know how to get in t<^ich^' 
with the individual. ■ ; 

3. Name and location of postsecondary school the 
individual attended or planned to attend. 

4. Name and location of the individual's em- 
• ployer. 

5. Neighbors of the individual or hisparents. 

6v Principal or other contact at the secondary 
school' attended". 

7. State or registration and identification number 
of driver's license. 

8. - Local government agencies. 

9. Armed Forces locator services or DOD rosters. 

10. Institutional records (i.e., prison, . police, 
mental). 

1 1 . Local credit bureau or a similar organization; 

As new addresses were obtained from tracing activities, 
returned mkil; or other sources, the computer, file of 
names and addresses was updated. 



C. Data Collection Activities . . 

1. Mail-Return Responses - 

Questionnaires (Forms A and B) were mailed on 
23-24 October- 1973 to 22,654 students in the first 
followup sample. Events following this mailout (table 
4-2) resulted in 13,928 returns and a 61.5 percent mail 
response ^rate by February 1, 1974. WJien necessary, 
additional questionnaires were mailed; 1,376 second 
Questionnaires were mailed as a- result of tracing 
' activities from November 16, 1973 through January 4, 
1974. *' 

Not shown in the 'table are the 107 duplicates, 
caused by timelag and error, 108 written refusals, a 
letter mailed with the second questionnaire to nonre- 
spondents, a letter of thanks sent to^all mail re- 
spondentsrand the computer-generated, self 'mailing' ID 
and changeof-address cards sent to all. participants 
after the fiht followup survey. ' . ■ / ; 

Figure 4-1 shows cumulative response: rates to all 
i mailouts. The bulk of the mail responses (61 percent) 
was received in the first* 3 weeks after the October 
1973 mailout. The data were 21 percent for the next 
3-week period and 18 percent for the final period prior 
to February 1, '1974. Additional mail questionnaires' 
were received later, during the field interview phase. 
The mail returns finally totaled 14,019 or 61.9 
percent. u 



Table 4-2.~OveraII mail returns and response rates, 1973-74 









_ Questionnaire response 

■ v « 


' .• ■ ' 

* Event . 


Number 
mailed 


, Days 
elapsed* 


Number 
re- 


Cu«iu- 
llve 


Overall 
response 

rate 
(percent) 






'' - i 


turned 


tou! 



First questionnaire mailout 


22,654 




mm* 






Reminder/thank-you post card 


22,654 


8 


2,615 


2,615 


• 11.5 


First prompting post card 


14,053 0 


23 


5,277~ 


7,892 


34.8 
$1A 


Second questionnaire mailout 


12,163** 


37 


1,723 


9,615 


Second prompting post card 


11,945** 




; 1,017 


10,652 


46.9 


Mailgram requests*** ' " . ; 


10,313 , 


53 


'1,502,- 


12,134, 


53.5 






72 • 


1,423 


13,57.7 


S8.8 


« • - • " * 




102 


37f 


13,928 


61.5 



♦Days since the first questfonnairemailout of l0/23-24 f 1973 (see fig. 4-1). • # 
**On 11/27-28, post cards were mailed to 2,183 of the 12,163;'on 12/4-5, second 
questionnaires were mailed to 3,080 of the 11,945. (Mailings were results of the special ^ 
study, section IV of this report.) ' - • 
***A final effort to increase the rate to 60 percent (a result of the special study). 
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Table 4-3 compares mail response rates of the 
base«year/first followup participants by sex, race, 
region, urbanization, and' family income as of the 
senior year in ^high school. Complete data were not 
available from base-year files on all variables fgr all 
students; for example, data on the resurvey respon- 
dents were missing sex, race, etc., which were gathered 
in the first followup in Form B. The response rates 
were highest fp/r females (71.0 percent) and for Whites 
(70.9 percerft). The South was lower (60.8 percent) 
than the other 'regions (awrage 66.8 percent). The 
degree, of -uctanizatioi) of the schools appeared Jp have 



little* effect on response; the nine categories ranged 
from 61.4 to 68.9 percent. There was a spread of 19.6 
percent in response rates affected by income; students' 
of the higher income families generally responded at a 
high rate. 

. 2. Effects of Mailouts 

Although it was not possible to determine the. 
effect of each mailout jpn the response rate/ <%, 
conclusion was that no appreciable effect is felt until 
about 5 days kft6r a mailout. This conclusion allowed 



Table 4-3.-Mait response rates of subpopulations 



•* * 


.{ \ .»»'. ; ' 

Subpopulation group 
f 


Number of participants 


Total 
response 




In sample 


Responding 


rate 
(percent) 




Sex f ■ • 

Male 

Female 


8,074 

8,201, ; 


4,864 

i n ' ■ ■ * 


60.3 
71.0 




Race 

Black " : 
White ; , 
Other 


2,023 
12,287 
1,550 


.989 
8,711 
888 


48.9 
70.9 
57.3 



Region 

Northeast 

Central 

South 

Wwt 

School Urbanization ; v 
T. 10, largest central city districts 

2. Next 90 largest central districts 

3. SMSA schools within 10 largest 

4. SMSA schools within nexj 90 largest 
* 5. Alt other SMSA schools 

6. Outside SMSA, 75000% urb'an 

7. Outside SMSA, 50-74% urban 

8. Oeptside SMSA, 25-49% urban ' ' 

9. Outside SMSA, 0-2496 urban 

Income 

Less than $3,000 

$ 3,000 to $ 6,000 

$ 6,000 to $ 7,500 

$ 7,500 to $ 9,000 

$ 9,000 to $10,500 # 
.$10,500 to $12,000 
.$12,000 tp $13^5QQ 

$13,500 tp .$'l5,b00 
;$15,000 to $18;000 

$18,000+. 



. 3,742 


2,522 


67.4 


4,857 


3,234 


66.6 


5,963 


3,626 


60.8 


3,157 


2,093 


66.3 


1,915 


1,225 




2,058 


"* 1,264 


61.4 


1,599 


1,102 


6,8:9 


2,834 


1397 


' .66.9 


3,258 ■ 


2,088 


64.1 


383 


252 


65.8 


1,724 


1,116 


64.7 


2,168 


1,414 . 


65.2 


1,570 


978 


62.3 


943 


510 


54.1 


- 1,621 


•:' . 965 


59.5 


1,462 


922 


63.1 


1,297 


830 


64.0 


1,524 


1,101 


72.2- 


1,216 


831 


' 68.3 


'1,106 


763 


69.0 


837 


615 


73.5 


" 1 ,082 


787 


72.7 


1,756 


, 1 ,294 


73.7 



the estimates of response rates that are shown in table 
j4-4, but it did not allow for cumulative effects caused 
by multiple mail requests. 

Table 4-4,-Estimates of .effect* of <I*{lputs on response 
rates 



Overall response rate 
(percent) 



Total '■ . 

First questionnaire mailout 
Reminder/than k-you post card 
First prompting post Card 
Second questionnaire mailout 
Second prompting post card 
Maiigram requests , 



61 

21 
16 
8 
6 

3 
7 



e overall mail re's f> arise *rafe, slightly more than 
61 percent^t4ifaje 4-5), appears to be high— considering 
the questionna|r?length {24-28 pages) and complexity 
and considering that no incentive was offered and that 
^"resurvey" students, (about 20 percent of the total) 



had no .prior'NLS involvement. The response rates; 
fpr : the resurvey group lagged well behind those for the 
base-year sample. Resurvey individuals did not receive 
spring 1972 familiarization; the tracing information 
(only the addresses on file at the high School graduated 
from, more than a year before) wasNftuch Jess 
; complete; ,{4 LS involvement was lacking;\nd the 
known mobiffty of this age group ma'de all Contacts 
difficult— all of these were detrimental to the overall 
response rate'. 



table 4*5 .-Response rates, by number of weeks after 
r ^ " mailings. . 



Weeks 
elapsec} 


Base-year 


Resurvey 




Overall 


participants 
rate* • 


participants 
rate 


Difference 


response 
rate 
















• • tfercer|t * 


1 


2 


28.0 


13.6 


14.4 


24.8 


3 


36.9 


19.2 


17.7 


33.0 


4 


42.3 


23.4 " 


18.9 


38.1 


■ 5 ' 


46.5 


27.1 


19.4 


,42.2 


* : 6 


50.1' " . 


29.8 


20.3 


45.6 


• 7 


55.3 


34.9 


20.4 


50.8 


8 


59!l 


38.9 


20.2 


54.6 


, 10 


64.0 


43.5 


20.5 


58.4 


15 


65.2 


47.1 


18.1 


61.5 



3. Personal Interviews 



Under a contract between OE and the Bureau of 
the Census, tracing information on 8,549 mail nonre- 
spondents (appended to blank questionnaires) was 
turned over to Census workers early in January 1974. 
This had been preceded by preliminary December 
listings of nonrespOndents distrib/ted by zip code and 
Census, district so (that the distrrcts 'could plarf wopJct. 
loads. ; ' C\ * J : •'. ' ' 

«• Although the purpose was to locate and obtain 
. personal interviews with all nonrespondents, a restric- 
tipn of -50 miles had to be imposed (due to the 
emerging fuel crisis) beyond which a telephone in- 
terview would have to suffice. This telephone interview 
contained a subset of 22 key questions-those deemed 
most critical for analyse^- be cause the entire question- 
naire 1 was too long for effective telephone interview. 

Fieldwprk began in late January 1974V By «th 
end of March all interviews (personal and teHe'ptioUcj 
had been completed for all av^ilajjle sample member 
Of the 8, ££9 cases referred, 7,331 were interviewed, 
for a grpss completion rate of the interview subsample 
of 85,8 percent., For personal interview, administration 
time averaged 45 minute*; by telephone it was about 
15. Ju^t over lp percent of these cases were completed 
"by telephone. ♦ / 

^ , 4: Checks on Data Quality 

. In Nov&mber' 1973, editors were, re.cr'uited and 
trained to perform data quality checks as tjie first 
followup returns carhe in .'-Each returned survey instru- 
ment was scan-edited, page by page to detect critical 
omissions and inconsistencies. The scan-edit averaged 
15 minutes per questionnaire. This review was designed 
to verify - 

' That* in general, the respondent had understood and 
followed the instructions (I.e., he had not given 
obviously false or capricious respbfises or in some 
other way shown an insincere effort in completing 
the questionnaire);*** ; 

That the major . critical skip patterns were correctly 
interpreted and that $0 block of applicable items 
was omitted; 

That each instrument was properly identified and all 
items requited for tracing were completed;* and 



*This verification was used in jhe check-in process and in 
the data quality checks because the critical nature of these items 
justified the added cost. 
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That questions deemed critical for minimal analyses 
relevant to survey objectives were answered ade- 
quately. 

Critical items selected for review included up to 22 
questions, depending on skip patterns; these covered ; 

■, - Current activities and plans, f / 

V'. — ^-Education and training since high school, $ 
^Civilian work experience since high school^ 
'\p Military' service . an d 

Background (tracing) information. 

The list of key items is in chapter III. Only key 
questions were examined for clarification or correction 
by the respondent. No other information was checked. 



The goals were not only to obtain answers to key 
questions but also to ensure that the, answers were 
consistent among themselves. Tables 4-6 and 4-7 show 
the results of the ptemachiner manual edit for mail and 
Census Bureau completions. 4 ' •-• 

If a questionnaire failed the edit .'checks,' its 
problems were noted on an Edit' Problem Sheet, the 
sheet and the questionnaire were routecPto the Tracing 
*Pet>artrrtfcnt, and. the staff (also trained editors and* 
interviewers) telepftoned the respondents. A- total of 
28.9 percent or 4,022 mail questionnaires failed to 
meet the minimum requirements establishe^and were 
turned over to the Tracing. .Department for telephone 
followup; of these, 3,822,' 95.0 percent, were 
completed successfully. Of the 34 Census Bureau 
questionnaires that failed edit specifications, -3 1 (91.2 
percent) were successfully completed. 



Jqble 4-6.-Tetephone followups of mail-return' questionnaires that failed edit 



* . specifications ' k 




■ / 


.+ . 










Mail-return questionnaire* 


Response category 


Form A 


• Form B 


Total 




Number 


Perc/ent 


Number 


/ 

Percent 


Number 


Percent 



Total 



All items completed 

One or more key items not completed 

jtefusajs, 

Respondents in* military overseas ' 
Respondents wi thou t telephone 
Respondents with unlisted numbers 
Other * v i < 

^ — ; A i — C-l* 



2,828 
22 
• 8 
' 25 
53 
8 

- 3« 



2,982 10 3.0 1,040* 100.0 4,022 100.0 



9fc.8 

.7 
.3 
.0.8 • 
1.8' 
0.3 1 

1 



947 
25 
4 
9 
26 
3 

,26 



91.1 
2.4 
0.4 

■, 0.9 
'2.5* 
0.3 
2.5 



3,775 
47 
12 
34 

79-; 

1P 
64 



93,9 
1.2 
. ■» 0.3 
0.8 
2.0 
0.3 
1.5 
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♦Clarifications of Forms A and B of the First Followup Questionnaire continued through April 29, * 
1974. t • 



Table 4-7.-Telephone followups of Census questionnaires that failed §d\t specifica- 



^ • ■ 



tions * *' 


7 












Re sp b nse^j(Reg«y^^*" 


Bureau of the Census questionnaire * 


Form A 


Form B . 


Total 


"Number 


Percent 


Number 


Percent 


Number 


Percent 


Total 

• ■* 


25 


100.0 ' 


9 


100.0 


34 


100.0 


AH items compel ted 


24 


96-9 ■ 


.7 


77.*_ 


31 


91.2 


One or more key items nofccomjrteied 




0.0 


1 


11.1 


' 4 


[ 2.9 


Refusals , v. , 


'. r . 


- 4.0 


0 


olo 


1 


\2.9 • 


Respondents without telephones 


i o 


0.0 


* v 1v 




• if, 




♦eiarificatronstf these questionnaire* c?ntTrtued through / 


Vpril 29, 197*4. 







D. Telephone Survei 



♦ A teiepHone intei 
subsample (N - 393) 



lew was conducted for a small 
f those who h$d not responded 



by mail 'as of December 17, 1973, The primary purpose 
was to find out somi reasons for mail nonresponses. 
The survey was conducted by the Telephone Tracing 
Department during the period December 18-28, 1973 



activities. It was not developed as a rigorous design to 
be used for comparisons of experimental treatments, 
but more as a practical guide for future NLS work. 

Broadly speaking, this special study was designed to 
compare (1) air mail and certified mail questionnaires, 
(2) telephone calls prior to the respondents' receipt of 
the questionnaires and prompting. calls made .after 
receipt, and (3) mailgrams and prompting post cards. 



with 299 base-year/ and rcsurvey jionresp on dents Table 4-8 indicates for each gi%^ Shown in figure 4-2, 
telcfcted by random sampling. Tfiere wcTre 22Qi(5^ fte date^ihe ^ 

,-pewltnt) sample numbers contacted, of wh9!Tt v 1^ 4, 1974/A11 of thfe STO sajhple member*, 



. were b^je-year participants and 51 were' resurvey 
members. Also, 98 family or household members were 
contacted (83 hfase-year). Reasons for nonresponse 

X^aned widely, including 19 who said they "never got 
th£^uestionnaire, v 26 who "lost the questionnaire," 

^3»fr*9 who ^'haven't had time." 

^secondary purpose of this telephone survey was 

" t6 probe -for actions to improve the response rate. Only 
90 persons answered in this'regard arid of the 540 total 
responses given (90 respondents x 6 answers each)/ 
only 33 percent Were positive about the various 

v suggestions *e.g., . "refeeivjn'g jjiore information about 
the study "/"receiving a $5 incentive 4 ^ 

✓ / - ■,. 

E. Special Study 

Knowing that NLS would continue beyond the first 
, (ollowup, ^ plan was developed to obtain information 
v for improving strategies forsubsequent effort^ without s 

disrupting the ongoing higlwespohse-ratfe . efforts. 
' Figure 4-2, the design of the followup procedure just 

discussed^indicates special ypplementary samples and 



^ ample 

■viftio iwejre ^ent *certlOed mail "Questionnaires were ' 
base-year participants. Even correcting for resurVey 
members among the other two initial groups, certified 
mail responses were about 10 percent over air mail 
responses. Telephone contact had the highfest impact 
on response rate. It was also by far the most expensive. 
Based on the costs and the need to reach a large 
number of nonrespondertts in "a short time, mailgrams 
appeared to bq the most cost effective. 

Once the response fates (table 4-8) for procedure^, 
and their costs and scheduling requirements weri 
known*, a* decision was made in early. December 1973, 
to send maDgrams^to all nonrespondepts; based on data 
at hand, the final response rate with this procedure was 
expected to be close to 60 percent. The 10313 
mailgrams sent on December 13 and 14 had an even 
more positive effect than anticipated. The overall 
' response rate was t>1 percent. Admittedly, it is hard to 
know how^many without this effort might have come 
' in from the college students s w\\p had spare time during 
the holiday season or who returnednomfe for vacation . 
and found the questionnaire. 



Table 4-8.~Special study mail-return response rates as of January 4, 1974 



r 







*■ 

'■ ■ * 


1973-74 ' 


■f> ■ 


• 'Subgroup 


* ■ 




Date and event* 


— jp 

Number 

mailed 


Number 
contacted 


Number 
returned 


* response 

rate 
(Percent) . 


10/23 


A. Telephone/air mail 

B. Certified mail 

C. Air mail 


404 
999 
21,251 s 


318 
913 
20,762 


273. 
690 
13,170 


/ 85.8 
75.6 
62.4 




11/13 


- D. Telephone 

E. Mailgram • $ % 

F. No followup 


'400 
398 
400 , 


365 

400** ' 


251 
198 
» 184 


d ( . 

68.8 
51.3 • 
46.0 




1 T*27^ 

■ i 

•> 


tf. digram ' 
> 1. No followup 
J. Telephone/mail 
K. Telephone * 


400 ( 
400 
399 
400 


3,94/ " 

330 
350 


153 
• 116* 
183 
198 


38.8 * ' 
29.0 
55.5 
56.6 




♦See Figure 4-2. 
♦♦Estimated. t 


33 











' Figucc 4-Z--Special study plan: NLS mailout and followup procedures, M4 



OctobcR3 & b 



October 30 4 31 



v 400:telephone.all'400 lo ♦boKcitftoalUOQ • * card to jtnuu , . / rr . , 

* advise of . . •' t ' ' 

! tificd mail to 1,000 Y* post card to all 1,000 ♦ cjrdtoain.w ,-, , • 



■'•■'•f>v r ■ 



/ 



D telephone 4t)0 nonrc- .' Send second prompting , 
( 'spondentsN • * cardtoill^pond^ .[ , 

LM*.»«» , ******* ± « — ^ l ftf* 
re ond ; nl5 card'to^H nonrespo^ents-. .nalre pall onre- , | f 

K »spondent5*y.# : 

F.No followup aciion.400 .Scndsecfnd Pff*^ 1 kJ 



C. Airmail questionnaire to all Send reminder/thank-ydV 
others, 23,000 -400 - post card to all 21,600 
1,000= 21,600 ' . , 



' 1 J . 



^respondents card to all nonrespogdcnjis 

- H.Send mailgram to 400 un- : 
' respondents 



G-Send 1st prompting post 
, l fafdto 1 allothfirs ! 2l ( 60b/ 

Y-1 1 



-No followup for 400non- 
respondents ^ 



♦Telephone contact*was also used to verify re- 
spondent's home address. 

•."Airmail rather than certified mail because of 
response rates and because individuals who 
were still nohrespondents had already, received 

':■ up to four mailings. , 

♦•♦Due to the Christmas holidays and the likely 
" Movement of sample ipembcrs, ma|j»ims were 
.sent to all nonrespondef&'earlier linDeceln- 
• ter 28: ... 



. ■ ,<■•, '. 

20,400 (max) \ .• I- Mail second questionnaire to 400 nonrc 

spondents and telephone all 400 to ad- — 

■■vise of mailing* 1 



K. Telephone 400 nonre- 
\ spondents* 1 

^ Send seconc prompting post 

card to 400 nonrespond- 
ents 



Send second prcMnpting 
f ) 



I , post card to all 



Wnd secend'questlonnalre to-* other nbnrespon 
Jjheri (^respondents • cnts 



■i • 



F. Resurvey School, Data Collection 

During the week of March 1K 4 1974, a packet was 
sent to resurvey schools, lu it were a computer lisiing 
of the resurvey students selected to participate, two 
copies of the School Questionnaire, individually 
labeled SRIF's for each sample member, instructions 
for completing these items. a postpaid return postcard 
for acknowledging receipt of these materials, and a 
postpaid return envelope for mailing completed ma- ' 
terials. No Counselor Questionnaires were requested 
As in the base-year survey, participating schools were 
paid $40 honararia to cover the cost of data collec-* 
tions,, % . 4 / 

1 Dtirihg the following week, post* cards acknowledg- * 
ing receipt of packets begarf* arriving and survey 



Questionnaires were mailed to the last known 
addresses of the sample of 22,654 on October 23-24, 
1973. This was followed by a planned sequence of 
reminder post cards, additional questionnaire mailings, 
and reminder mailgrams to/ nonrespondents. Active 
mail-return efforts continued through December 1973;. 
by early February 1974, the questionnaire-return rate 
by mail was 6 J .5 percent. Questionnaires continued Jo 
arrive through the mail during the field interview phaj£ : 
of the survey. 

The names and addresses. of those sample members 
who failed to mail back their questionnaires were then 
turned over to the bureau of the Census for personal 
interview in accordance with a Bureau arrangement- 
with pfe. This personal interview phase oPfifSt fol- 
lowup data collection continued until April 1974, "at 



t specialists begah' receiving telep^ie ca^rfrom resur- . which time the overall response rate had been increased 



vey schools (about 1 00)T "regarding problems-riamely, 
confusion over ID numbers, the need for maiden 
raamefc, misundtfttan dings of toe SRIF's, and permis* 

^sion codes and signature verifications for permission. 
Bttpit; April 26 deadline for receipt of data collection 

. materials, 155 acknowledging post cards and 85 com- 
pleted packets had been received. Prompting telephone 

*calls were made to the schools from whom post cards, 
but no data collection packets, had been received. No 
responses had been received from 105 schools; these 
105 received reminder telephone 'calls from the project 
director. 

About 23 May, mailgraras and letters were sent to 

I ;344 resurvey members who had neglected to sign the 

permission line for acquiring SRIF data. In the fall of 

1974, a final effort was made to secure the remaining 

SRIF's-the. resurvey schools were ^askedj to siibmit ^ 

transcripts only for remaining resurvey students, and 

the data was transfered to SRIFY 
I * ' i 

G. First Followup Data Collection Summary 

The first step in data collectipn for the first 
followup involved an extensive tracing operation to 
update name and address files received • from the 
previous con tractor for the base-year survey. A total of 
18,672 of tftase individuals from 1,044 schools were 
used for the frtst followup survey. In addition, individ- 
ual? from/ 256 ire#urvey schools were added to the 
base-year Jists to give a first followup survey sample of 
1300 schools anil 22,654 individuals. Newsletters were 
developed and mailed not only to encourage participa- 
• tion bu/ also to $erve as vehicles for upaWing names 
and' addresses. When mail was returned by the postal 
service as- yndeliverable, telephone tracing procedures 
were used to obtain current addresses where possible. 



fo.94.2 percent (21 ,3$0 respondents out of 22,654).. 



H. Recommendations 



Recommendations based on the special study of the 
first followup survey are for improvements in the 
questionnaire, the prequestionnaire letter, the news- 
letter, the ID card, and the mailout plan. 

1. Simplify the Questionnaire 

Directions and procedures for answering ques- 
tions and following skip patterns need to be improved 
to elicit Gorrect. answers to appropriate questions. An 
example is needed on the inside of the front cover to 
show how to answer questions. 

2. Prepare an Advisory Letter 
Several weeks before the questionnaire mailout, 



an advjgpfy letter Should be sent to parents of sample 
merfffTers whose first followup address is the same as 
that of the parents. This letter woufld explain that a 
package of survey materials for their son or daughter (a 
1972 senior)' will arrive within a few weeks, and^it 
would ask the parents to either forward the package 
(instead of holding for the return from College, etc.) or 
to call collect with another address for a second 
mailing. 

Approximately 1 week before the questionnaire 
mailout, a brief plvisory letter should be mailed to ail 
sample members at their most likely address at the 
time; of survey to explain that they should be receiving 
survey matfrials within 10 days by certified* mail/ 
Certified mail is one way to imply importance and to 
elici (responses at minimal cost. 
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3. Uw Maflgrami and Prompting Post Cards 

Half of the nonrespondents to the first question- 
naire mailout of the second followup should be sent 
mailgrams; the other half, prompting post cards. For 
the second questionnaire mailout, this should be 
reversed: those who received mailgrams before should 
receive, post ca/ds, and vice versa, Totai responses to 
♦ these two shoujd help determine the.cost effectiveness 
of 'mailgrams, t 

4. Improve the Newsletter and ID Cards 

Thc : newsletter should contain more resul^ 
oriented data to ehcit interest in the growth an<K 
activities of the class or age group. Adoption of a 
newspaper format and inclusion of pe/ronal interest 
stories about sample members, staff^ffnd processes 
should be helpful. % 



Several hundred ID cards were returned in 
1973-74. with correct addresses: however, the re- 
spondent's name and address Were. easily smudged and 
became illegible. A new, nonCarbon format should be 
adopted. , , 

5, Consider Other Tracing Aids 

• \, 

Time lapses between data collections (\5 months 
elapsed between base year 1972 and the first f973 
mailout ofjkewsletters) can decrease die efficiency of 
tracing efforts. Therefore, new tracing aids should be 
considered for improving follows. Everi»though die 
use of the credit bureau system was nol helpful in 
the fifst followup, it may be that as ^Hidy members 
mature -and establish their own households it can be 
a useful, low-cost source of tracing information. 



* 




Chapter V 
PREPARATION OF THE NLS DATA FILE 



Questionnaires returned by mail, either from indi- 
vidual sample members or from Bureau of the Census 
interviewers, were routed on a flow basis to a central 
check-in point. First, each respondent's ID number and 
batch number were transmitted to the data processing 
section for a daily count of the questionnaires received. 
Then, batches were routed to the premachine (manual) 
editing section to see if each questionnaire contained 
the minimum set of key data. Questionnaires which 
passed this check were transmitted to the direct data 
entry section) to be transformed into machine readable 
form. For questionnaires which failed the check, 
telephone contacts were •made with the respondents to 
resolve problems uncovered in manual edit; after 
resolution, the questionnaires were transmitted to the 
direct data entry section for encoding. At each point 
along the Youte. events were entered into the. auto- 
mated survey support system so there would be 
constant monitoring of the location of all question- 
naires in the document flow process. 

After data were encoded, j questionnaires were 
placed in temporary secure storage prior to microfilm- 
ing and eventual destruction,. (Microfilming of the fust 
followup data was completed in the Summer of 1974.) 
The microfilming was initiated to provide greater 
assurance of confidentiality, to simplify accessibility of 
original data, to reduce storage costs (several tons of 
hard copy were transferred to microfiche), and to 
ensure against loss by separate storage Af a second 
filmed copy. 

A. Pre-Machine Editing 

The premachine editing centered around the .fol- 
lowing ideas: If "key" questions were answered or 
could be presumed by responses to related items, a 
questionnaire would be accepted-no matter how little 
other information was given; however, if any key data 
(described in chapter III) were missing, the respondent 
would be telephoned to complete the record. 

After a questionnaire had passed the editing require- 



ments, the alphabetic data in a few parts of trje 
questionnaire were manually coded into numeric form 
before transformation into machine readable form. 
Two questions (49a,55a) about job area or occupation 
for 1972 and 1973 were transformed into the corre- 
sponding 3-digit codes specified in the Census Occupa- 
tional Classificatfbn System; the parental occupation 
question (79) was likewise coded.* Postsecondary 
school identification (college, university,* vocational/ 
technical) was transformed into six-digit FICE** codes 
by using a master index provided by OE. For fields of 
study (22b,26a,36a,6,0b), both the four-digit academic 
subdivisions provided by the HEGIS (Higher Education 
General Information Survey) taxonomy and the six- 
digit HEGIS technological and occupational 'schemes 
were, used.t Finally, the responses to question 43b 
were coded numerically to indicate type of license, 
certificate, or diploma.ft 

There were 18 questions in the First Followup 
Questionnaire for which respondents could select 
either fixed-choice (dosed*response) answers or writi** 
in answers for the "other" option. In every case 
possible, the "other" option was reclassified by the 
manual editors into the fixed-choice options; when 
reclassification, was pot obvious or logical, the "other" 
was retained in the coding, but the alphabetic descrip- 
tion was not included on the data file. There were four 
questions (44ba.69b.69c,70b) in the\ First Followup 
Questionnaire that were not numerically coded (i.e., 
they were coded as written on the questionnaire). 

NLS first followup data were transformed to ma- 
chine readable form by using direct data entry pro- 



*Codes are in appendix C of the Base-Year and First follow- 
up Data file Users 1 Manual. This document is hereafter referred 
to as the Data File Users' Manual or the Users* Manual. 

**FICE codes axe six-digit serial numbers used to identify 
U.S. institutions of higher education (thoje offering 2 or more 
years of college); these codes are available in NCES directories 
and from the OE computerized "Vendor's File. 

t Append ix D-l. Users* Manual. 

ft Appendix D-2, Users' Manual: 
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gramable terminals. Major advantages of this pro 
cedure were higher speed, fewer processing steps, 
and lower transcription error rule. The overall error 
rate was less than 0.3 percent. The terminals were 
*p programed to accept a specific range of values for most 
' of the data -and specific field widths for all data. 
Response ranges for fixed-format variables decided 
upon prior to data entry were programed for the ler- 
... mjnals; other responses were coded to indicate they 
wjtee outside ofW ranges. 

B. Error Coding 

A set of "error" codes was applied uniformly across 
the file to indicate classes of erroneous or missing data. 
The codes are explained below : 

■ * ■ 

$3-Partial response. Used, for questions with the 
* two-column response format lo indicate 
. whether each subitem applies or not. If at least 

one was answered, the unanswered subitems 

were coded 93 J 

93 -Don't knbw. (self-explanatory). 

95 -Out-vf -range response. Used when a response 
. or transcription exceeded an acceptable range. 

* 96-Multiple response. Used when there were sev- 
eral tffisWe"rs to a question when the directions 
*call for only one. 

♦ . ** ,■ 

91 -RefUsal. r- . 

• : « . 

9&~BJank, or nonresponse. Used for nonresponse 
cases not identified as legitimate nonresponse 
(see section C-3 below). 

99 -Legitimate nonresponse. Used* when the re- 
spondent should not and dfd : not answer the 
question (i.e., he was routed around it) or did 
not answer an entire instrument. In the Jailer 
case, all fields were. coded 99 {see section C-3 
below). . 

Jhe above error codes were .applied to items with 
■two-digit fields only;, these are by far the most 
common type ia the file. For items with threerdigit 
fields, the' error -codes haw two leading 9*s follQwed by 

fiFirstfoBowup guettions that received 93 codes were 1, 16, 
22a, 24. 29b, 31. 35, 38. 44b. 48p K 54b.'62,63, 71. 76. 



the digit indicating the erroj class that ii.993 through 
W, For four-, five-, and.siX-digil fields, the number of- 
leading 9's was increased accordingly. 

C Machine Editing 

Preparing the NLS data tapes for public release 
required "hard copy" (s6urce document) spot checks 
and machine editing to recodc all unintcrprctablc 
responses and some logical rccoding of the responses. 
. Thus, the final, data file contains only valid response 
codes, erroneous or missing data codes, and "logically 
recoded values" with indicators for the reason^ for 
re£b<i m 8 (section 3 below). : . 

- Yhree machine-editing programs-ramje checks, con* 
sistency checks, and routing checks-weTre used se- 
quentially fonthe first followup data. These programs 
were not applied to the NLS base-year data; these data, 
edited by the previous contractor, were* either refor- 
mated or recoded to achieve consistency with the first 
followup data on file*. 

*# 

1. Range Checks 

* The first program checked the Responses to each 
fixed<h6ice item against a range of Acceptable values 
and "flagged" and recoded with 95 ^ny yalue outside 
of the fangc. Acceptable ranges for 72 numerically 
coded open-response items and thl number of re- 
sponses outside these ranges are tabulated in table 5-1 . 
In almost all cases, some responses were outside of 
these ranges. In general, these responses were logically 
possible but highly improbable. It was felt that some 
outlying responses could provide additional data, and 
'-that it was best to leave them in the field to provide as 
faithful a transcription of the origfnal records as 
possible.* 

2. Consistency Checks 

The second program checked the consistency of 
an individual's responses over the entire questionnaire 
against a set of 94 .internal checks (or response 
comparisons) selected a priori.^ The program read the 
responses and flagged those which were failed; then an 
'index was computed for. each record to indicate the 
internal consistency and to provide the user a rough 
indication of data quality. 



•Computer tapes are available with the out-of- range values 
replaced by the appropriate 95 out-of-range code. 



Table's- 1.-Out-of-ran§/ responses to free-response questions calling for ' 
1 numeric answers v. 



/ 



Opeit*G#sponse 


Range of 


Number of 


Open- response 


Range of 


Number of 


question 


Acceptable 


out-of-range 


Question 


acceptable 


out-of-rjnge 


number 


Values - 


responses 


» number 


values 

l: 


response* 

L. 


3A 


112 


6 ' 


. . 

47BB 


0-9,000 


1 


IB 


71-73 


15 


47CB 


0-9,000 


0 


7« 


1-12 


6 


47DB 


0-9,000 


0 


7C 


67-74 


2 


*7|B , . 


e-9,000 


0' • 


8B 


M 


1 


47F&* 


0-9,000 


o ' 


1 1 A 


0-20,000 


39 


47tiB 


0-9,000 


0 


MB 


0-20,000 


16 


49FA 


Mi 


5. ' o 


1 1C 


0-20,000 


28 


49FB 


63-74 


26 


1 ID 


0-20,000 


6 


50A 


1-50 


,.684 


1 1E , 


0-6,000 


7 


50 B '* 


6-1.0Q0 ) 


83 


1.1 F 


, 0*6,000 


1 


55FA -4, 


1-12 


■ " 7 J 


11 G 


0-10,000 


7 


55FB 


63-72 


164. A 


1 1H 


0-10,000 


0 


55GB 


1-12 


27 


2MA 


1-12 


4 


55GC. 


72-74 


41 * 


27AB 


68-73 > 


9, 

s 


56A 


1-50 


539 


27C 


0-50 


36 


56 B 


o-i;ooo 


75 


}3AA 


1-12 


2 


58A 


0-52 


'51 


33AB ■* 


68-72 


125 


58 B 


0-52 


2 


33C 


0-50 


57 


58C 


0-92 


.° 


4 OCA 


1-12 


1 


66 B 


. M2 


3 


40CB 


68-74" 


4 


66C 


68-74 


; ' 3 


400B 


1-12 


2 


66 D 


1-12 


2 


40DC 


68-74 


1 


• 66E 


69-72 


7 


4.1CA 


0-92 


0 


67A ' 


1-12 


4 


4 1CB 


0-92 


0 


, 67B 


72-74 


10 


4 ICC 


0-120* 


" . 21 


J4B 


1-12 




46AA 


Q-^,000 


1 


74C 


68-74 


23 


46AB 


0-12 


176' 


82DA 


0-9,000 


0 


46BA 


0-5,000 


21 


92QB 


0-9,000 


0 


46BB 


0-2,000 


65 


8 2 DC 


0-9,000 


0 


46BC 


0-1 ,000 Q 


47 ' 


83DA 


0-9,0p0 


0 


46BD 


0-1i000 y 


73 


83DB 


0-9,000 


0 


46BE 


0-1,000 


115 


83DC 


0-9,000 


0 - 


46BF 


0-9,993 


0 


84DA 


0-9,000 


2 


46BG 


0-4,000 


29 


84DB 


0-9,000 • v 


0 * " 


47AB.. a 


= 0-9,000 


3 


84 DC 


-0-9,000 


\ 1 



3L Routing Checks 

The First Foilovftyp Questionnaire contains 33 
questions that either implicitly of explicitly direpted a 
respondent around those questions that did not apply . 
To determine if the respondent correctly followed the 
routing pattern** a routing-check program was devel- 
oped and implemented. It readjeach record and flagged 
responses that were inconsistent with the subsequent 
pattern of response. The flag? indicated the type of 
inconsistency detected: . 

• a. Inconsistency .occurring when the response' to a 
cputing item indicates that the questions within 



the routing patternJshould have been skipped but 
were not. These were recoded by adding 20 to 
- the original response code. * 

b. Inconsistency occurring when the Response, to ' 
the routing item indicates that the questions 
should have been answered but were riot. Reced- 
ing added 40 tq the original response code. 

c. Inconsistency occurring as a combination of the 
' first two types when the responA ta the routing 

item indicates that certaliL^gu$*uons which 
should have been skipped were not (type a) and 
others should have been answered And were not 



(type b). Rccoding added 60 (20 + 40) to the 
1 original response codes. 

Examples in the t)ata File Users' Manual clarify the 
» jesting and recoding procedures employed by the 
routing-check edit program, and appendix E.l of the 
manual, lists* codes fpr , consistent and inconsistent 
responses to the 33 routing questions in the question- 
naire. ; " f 

: -"> The> routing-check program also differentiated 
between legitimate nonresponse (code 99) and illegiti- 
mate nonresponse (code 98). Legitimate nonresponse 
pertains to questions that, the respondent was routed 
around. If a respondent was routed into a block, any 
nonresponse to those items is illegitimate; if the 
routing pattern is answered inconsistently (20, 40," or 
60 added' to it) with the routing instructions, any 
npnresponse to those items' is illegitimate. The only 
time that a nonresponse was coded 99^ was when there 
was an unflagged response to the question that routed 
"the respondent around a group of questions. If a 
- response pattern did not clearly indicate which ques- 
,tioris the respondent should have answered, the nohre : 
sponse was coded 98. In some of the more complex 
routing patterns, nonresponse was coded 98 for. a large, 
section of items due' to one inconsistency. The user * 
should be careful in interpreting the 98 and 99 codes' 
to avoid overestimating the number of Illegitimate 
responses. '■ 
For qjttte analyses, the user may wish to redefine 
legitimate and illegitimate skips. Appendix E.2 of the 
Data File Users' Manual lists all the questions in the 
first followup that should be checked because they.are- 
inside of one or more routing patterns. A question not 
in this listing is not 'in any routing patterns. .To 
determine the legitimacy of nonresponse, all of* the 
routing' questions that cover a question should be 
considered. 

D. The NLS Data File Indices 

Two kinds of composite indices— quality and ana- 
lytic—were developed and placed in the NLS data file. 
The quality indices quantify the amount and quality of 
data in the individual record. The analytic indices 
(derived from global considerations of the entire file) 
are classification variables used to group the individual 
records. 



1 . Quality Indices 

Four quality indices were developed to quantify 



the amount and quality of First Followup Question- 
naire data in each record. Each index was allocated a 
three-digit field on the record, table 5-2 presents the 
quality indices. 

Consistency index (CS) represents 'the percentage 
(truncated set of 94 checks) failed by an individual. 
' The index was computed as 

i ■ 1.94 

. k cs = ' 9 ' 4 ,v * . 100 , 

whertf Xj is 0, if^respondent passed or 1 if failed 
check i/ * * V* 

' .*•.-. 
Out-of-rangp index (OR) represents the percentage 
of out-of-range responses fpr an Individuals It was 
computed as , . ' * 

OR*= N/D • 100 \ 

• * 
. where N is the number of items coded 95 (o.ut-of- 
. . range) and D is the number with response other' 
than 99 (legitimate skip). 

. Routing 'index (RI) represents the percentage of ' 
routing questions ambiguously answered (i.e., un- 
answered or ans wered inconsistently with the $ubse- ' 
queht response pattern). The index was computed 

- t 

s RI = N/D ■ lOO-'' V ; * . • 

where N is the number of flagged ra§ ting* questions 
and' D is the number of routing questions with 
responses other than 99. 

Completeness index (OA through C/£/f epresents the 
percentage of items with responses ' (not coded' 
93-98,) for each of five sections (A-E) in the 
questionnaire. The* index was computed. as follows 

CI X = N/D * 100 .', 

if H 

wh'ere x is the ' section (A,B,C,D, or E), N is the 
number of items with valid responses, and D is the 
.-number of items with responses other than 99. 

Table 5-2 indicates lower completion rates for* 
sections A and B of the questionnaire than for other 



Tabic 5-2.-QUaHty of individiajr^ponses to'f irst Followup Questionnaire 



idual re? 



Questionnaire responses 



* Quality index 



Data file code 



Number 



Percent 



1. Consistency index 



*2. Out-of-range index 



3. . Routing index 




9,574 
5,781 
3,204 
1,321 

•■■ 6J0 
. 323 
477 

19,018 
2,066 
145 

• 50 
33 
6 

*' . 32 

12,187 
: 4;403 
3,147 
1,024 
. 473 
85 
31 



. 44.84 
27.07 
15:00 
6.19 
3J4 

2.23 

89.10 
9.67 
0.68 
0.23 
0.15. 
O.03 
0J5 

57.08 
20.62. 
14,74 
^4.80 
2.22 
0.40 
0J5 . 



4. Completion 
"index 



Questionnaire sections 

: C ' 



(percent) 


Number 


Percent 


Number 


Percent 


Number 


Percent * 


JMjumber 


Percent 


6 Number, 


Percent 


10t)-91* + 


4,074 


19.08 


6,854 


32.11 


16,494 


77.26 


20,394 


95.53 


17,077 


79.99 


90-81 


10,203 


47.79 


. 6,232 


29.19 


920 


4.31 


86 


(£41 


913 


4.28 


80-71 . 


3,558 


16.67 


1,907 


, ," 8.94 


920 


4.31 


79 


0.37 


695 


3.26 


70-61 


1,949 


9.13 


t 1,281 


6.00 


581 


2.73 


36 


0.17 


422 


1.98 


60-51 - 


338 


1.60 


964 


4.52 


308 


1.45 


20 


0.10 


267 


K25 


50-41 


' 84 


0.40 


710 


3.33 


449 


2.11 


369 


- 1.73 


456 


2.14 


'40-0 


1,144 


5.36 


3,402 


15.94 


1,678 


7.86 


'366: 


1.72 


.1,520 


7.12 



*0 means no consistency checks failed.. 
**0 meSns no out-of-range numeric. responses. 

+0 means no routing questions answered ambiguously 1 . 
++100 percent means all items completed. 

'• • ' ' ' ^ u , \, 

sections. This result is artifactual and may be mislead- 
ing. The major utility of this index is in judging the 
completeness of an individual's responses within a 
section, not between sections, because* the sections 
vary in complexity, number, of routing patterns, and 
types of information elicited. Section A contains fewer 
routing patterns than other sections, but contains some 
yitems (e g., IGV for which one m& expect larger 
nonresponse; also the routing check rules for item H 
specify code 98 for all nonresponses and thus inflate 
the nonresponse. Review of the indices within a section 



will illustrate the typical completion rate and identify 
outlying individuals. 

The utility of quality indices is in judging the 
credibility of individual records. They are of no use\n 
judging data, over respondents such as item, responses,! 
since the real test of item' response quality is the 
over-subjects distribution. It is recommended that 
these indices not be used for discarding subjects unless 
one's concern is with either the .entire, instrument or 
subsection. •» 

The machine editing indices just discussed were 
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modified somewhat in developing a second level of edit 
version of the NLS data file-deliverable as a part of 
second followup survey work. Users of the second level 
of edit file should consult the Data file, Users' Manual 
for that file. V * 

£ Analytic Indices 

Two composite indices-an ability index and a 
socioeconomic status (SES) index-involve several com- 
ponents each and required several steps during deriva- 
tion. Since others-components and procedures may be. 
used in deriving such indices, users are encouraged to 
decide ; whether the indices included here are appropri- 
» ate for their needs. - 

Ability Index. Each NLS participant's code of 1 , 2, 
or 3 indicates an ability composite score in the 
u Jower, middle two, or upp^er quartile: 

3 = upper quartile if K 225.7497', 

2 = middle tyQ quartiles if < 225.7497 and 

> 181.5461, 
1 = lower quartile if > 181.54(1. 

The^e>ere derived from vocabulary, reading, letter 
•group, and mathematics test scores. A- simple sum 
over the four scores (each with a mean of 50 and a 
standard deviation of 10) 'was accepted as the 
general ability index because an analysis yielded a 
first principal component with' essentially equal 
weights for the four and a rotated factor which 
explained the most common variance gave essenti- 
ally the same result* 

SES Index. Each NLS participant was also assigned 
1, 2, or 3 indicating an SES composite score in the 
lotfer, middle two, or upper quartile: - 

3 - upper quartile if > +0.4735, 

^ ' 2 = middle quartiles if < +0.4735, and - 
... " > -0.4735, 

I 1 =1 lower quartile if< -0.4735. 



The composite has five components: father's educa- 
tion, mother's education, parent's income, father's^ 
occupation i and household items. Factor analysis of 
*the five revealed a common factor with approxi- 
mately equal weights for each. Then each was 
. standardized. An equally weighted combination of 
the five standard scores yielded the SES, composite 
scores. _ 

\ 

E. The NLS Data Files 

r ' ■ > 

Two data files* were developed and' derived: the 
NLS master file and the NLS.release file. Each of them 
has a computer-generated NLS .variable list and NLS 
response list to provide details of the data stored in 
each record of the file. The variable list contains the 
name and description of each variable, the field or 
character positions containing each ^variable, and a' 
response Ijst reference code for each variable. The 
response list catalogs the valid response codes for types 
of variables iii the variable list. * 

The variable lists reveal , that a number of the NLS 
variables (items) fronnthe base-year and first followup 
were deleted from the master file to create the release 
file, primarily to protect the confidentiality of individ- 
ual data M Others wercdeleted or rnodified due to 
excessive prior editing or poor response. The complete 
computer data file, or master file, for which general 
release wa^ nbt contemplated, contains all data col- 
lected. 

The variable list shows that the data in each 1 record . 
are, in general, grouped and ordered by identification 
codes, data indicators, Test Book data, SRfF data, 
Base-Year Student Questionnaire data, First Followup 
Questionnaire data, .quality indices, sampling weights,, 
school data, analytic indices, and activity statuses. 

The r|Umber of respondents and amounts of data 
available for subpo^ulations and for combinations of 
instruments for two survey^.periods are tabulated in 
Table 5-3. Foi^more details of the release file, consult 
appendix F of the Data, File Users' Manual. ' . 
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Table 5-3,-Numbcr of responses by subpopulations to survey instruments 







— 


Survey instrument 




■v. 


» 


O on 1 1 1 it! An 
rUpUIdLLOn 

* group 


B-Y 

(Base Vcar 
Student 


FFU 
(First 
Follow-Up 


* SRIF 
(School 
Record 


TB, . 
(Test 


B-Y 
and • 


B-Y, 
FffO 


B'Y, 
FFU, 


B-Y, 
FFU, 
SRIF, 




Question- 4 


Question-,,. 


Informal 


Book) 


FFU 


and 


and 


and 




naire) ^ 


naire) 


tion Form) 






SRIF 


- 


.' TB 


.Total 


16,683 


21,350 


20,651 


15,859 


15,635 


15,618 


14,863 


14,848 


Caw 












■ , 






Male 


8,275 


10,463 , 


10,233 


' 7,894 


7,665 


7,658 


7,307 


7,301 


Femaje 


8,397 


.10,841/ 


10,376 


7,953 


7,967 


7,957 


7,553 


7,544 


Unclassifiable 


n 

■ . • . » 


46 


42 ; 


. 12 


• .3 


3 . 


3 


3 


• 

Race 












■ i 






White 


'12,656 • 


„15,272 


14,721 . 


. 12,111 


11,949 


1 1 ,9^8 


1 1 ,4^2 ? 


11,433 


Blacky $ 


2,083 


. ,2,739 - 


2,592 


" 1,906 


' 1,9?0 


1,917 


1,766 


1,763 


Other 


1,605 .- 


1,829 • 


1<816 :• 


1,508 


1,468 


1,465 


1,379 


1,376 


Unclassifiable 

** • 


339 


1,510 


f,522 


334 , 


298 


298 


276 


27J5 


High school 


















program 


















Academic 


rf,811 


8,511 


8,312 


6,531 


6,468 


6,465 


6,204 


6,201 


General * 


5,665 


7,492 


7,253 


5,363- 


5,235 


5,224 


4,955 


4,944 


Voc/tech 


4,201 


5,148 


' 5,063 ' . 


>,956 


. h 3,927 


.3,924 


3,699 


3,698 


Unclassifiable 


6 


199 


23 


9 


- ** S- 




5 




- Region 


















North 


3,618 • 


4,483' 


4,316 


3,521 


3,420 


K 3,420 n 3,323 


3,323 


Central 


4,568 


5,541 • 


5,468 


4,122 


4,292 


4,28(8 


3,875 


3,873 


South 


5,513 


7,691 


* 7,242 


5,382 


5,186 


5,178 


5,057 


5,049 


West 


2,984 


3,635 ; 


3,625 


2,834 


2,737 


2,732 


2,608 


2,603 


Unclassifiable 




... > 


... 












Ability 


















Low 


4,788 


4,392 


4,7*3 . 




4,382 


4,374 


4,382 


4,374 ' 


Medium 


t 7,000 


6,600 


' 6,997 


7,008 


6,592 


6,585 


6,592 


6,585' 


High 


4,052 


3,890 


4,052 


4,053 


3,889 


3,889 


3,889 


3,889 


Unclassifiable 


843 


6,468 


4,819 




112' 


770 






SES 
















Low 


5,076 


6,"423 


* 6,227 


4,775 


4,735 


4,729 


4,458 


4,453 


'Medium 


7,816 


9,635 


9,393 


7,448 


7,320 


7,310 


6,971 


6,962 


High 


3,667 


4,686 , 


4,499 


3,525 


3,506 


3,505 


3,370 . 


3,369 


Unclassifiable 


124 


•606 


532 


111 


, 74 


74 ■. 


<|64 


64 



Chapter VI 
WEIGHT CALCULATIONS 



The sample for the NLS study is highly stratified, 
multistage, and clustered. As a consequence of the 
complex: Resign, each observation (response) must be 
weighted in order to obtain unbiased sample estimates ' 
of population parameters. Fdr all students sampled, the 
unadjusted weights are calculated as the inverses of the 
probabilities of being included in the sample. For 
several sets of nonrespondents, adjusted weights were 
calculated using the weighting-class methods described 
herein. 



students 



who 



had completed either a Base-Year Stu- 



■ 1 



A. Unadjusted Student Weights' 

First, it was necessary to determine which schools 
and students were "uv sample" for the 1972 NLS 
project. The NLS sample design included 1,200 pri- 
mary sample schools (2 per final stratum) and 21,600* 
students (18 per school). The number of schools was 
increased (up to three or four per stratum) by using 
backup schools in the base-year and first followup sur- 
veys and by obtaining responses from all primary sam- 
ple schools, in the resurvey. Included in the NLS sample 

were— » 

.1,153 participating primary sample schools 

21 non participating (no 1972 seniors) primary 

sample schools 

131 participating backup sample schools 

18 extra, base-year backup sample schools 

16 augmentation sample' schools 



1 ,339 NLS sample schools 

The release tape contains data for students representing 
1,3 18 schools-all of the l,339schools in the final NLS 
sample except the 21 primary sample schools with no 
1972 seniors. 

It would have been possible to reduce the number 
to the 1,200 originally intended, but this alternative 
was not chosen since,- considerable base-year student 
data would have had to have been discarded, the alter- 
native chosen was to include all sample schools with 



dent Questionnaire or a First Followup Questionnaire., 

L School Selection Probabilities 

For each school in the original 600 final strata, 
<4he sample inclusion probability, Ifa, was calculated as 



where n n = number of schools in the final NLS 

sample for stratum-h, 
Aftj = size measure for. scfiool-i of stratum-h, 

-an d »" . r ' 

A n = sum of size measures for all schools in 

stratum-h. 

For schools in the smallest size strata (those with < 300 
seniors), the size measure was ejther the estimated - 
number of seniors in the school or 18, whichever was 
larger For schools in the two largest size strata, the 
size measure was equal to 1. Thus, schools in the 
smallest size strata were selected with, probabilities 
proportional to the number of seniors, and schools irf 
the two largest size strata were selected with equal 
probabilities. t 
A sample of 200 school districts was canvassed 
during the base year to identify public schools which 
were not in the sampling frame. A total of 45 schools 
were identified, and 23 were randomly selected as an 
augmentation sample, 1 School selection probabilities, 
Pj, were calculated for each of the 45 schools, as 
suggested by the NLS sampling contractor.? The 16 



1 Educational Testing Service. \913.The BascYear Survey 
of the National Longitudinal Study of the High School Class of 
^ 1972- Final Report. Princeton New Jersey. * 

k WEST AT, Inc. 1972. Sample Design for 'the Selection of a . 
Sample of Schools With Twelfth* Graders for a Longitudinal 
Study. Rockville, Maryland. 
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participating augmentation schools were grouped into 
strata (h*= 601 , 602, .... 608). For these 1 6 schools, the 
sample inclusion probabilities, adjusted for school 
nonresponse,.were calculated as 

2. Student Weights * ' 

The number of students from each sample schcita 
Avas taken as the number of eligible students offered a 
.chance to be in the sample. This included ali^ample 
eligibles '(respondents and nonrespondents), but ex- 
cluded ineligibles such as dropouts, early graduates, 
and adult education students. 

There were 23,451 sample students, 'ofr whom 
16,683 completed a Base-Year Student Questionnaire 
and 21,350.completed a First Followup Questionnaire. 
For each of the 23,451 selected students, the unad- 
justed student weight, %hij» was calculated as 



Wyhij 55 

\ 



Phi 



n hi^ 



. where = numbej of senior students in school-hi, 

and 

n hi = n urn be 
school- 



of sampled students in 



The sum of the unadjusted student weights is an 
estimate of the totjfl number of 1972 high school 
seniors in the population. If all of the selected students 
had completed^Ke survey instruments, these weights 
wourd be appropriate for the analyses of student data.* 

B. "Nonresponse Adjustments ' 

Handling nonresponse when analyzing survey data is 
a problem. In general, the mean values oT most survey 
variables are different for respondents and non- 
respondents. If the differences are large, or if the survey 
response rates are low, adjustments are used in an 
attempt to reduce the bias due to non/esjponse. N 

A weighting-class method was used., to adjust the 
NLS student weights for questionnaire nonresponse, 
i but not for item nonresponse within completed ques- 
tionnaires. Different response rates for students in 
different weighting classes were reflected in the adjust- 
ments^ The method involved partitioning the entire 
sample (respondents and nonrespondents) into weight- 
ing classes-homogeneous groups of students with 
respect to the survey classification variables. 



1. Classifier Variables 

The five classifier variables used to define weight- 
ing classes were: ^ 

Race-White or non-White; 
Sex-male or female*; 

High school curriculum-general, academic, or voca-* 
t 

tional/technical; 
High school grades— B or better, or C or below; and 
Parents' education— less than high school graduate, 

high school graduate-, some beyond high school, 

or college graduate. 

For the values of the classifier variables, the SRIF's, 
Base-Year Student Questionnaires, and First Folio wup 
Questionnaires were potential sources: (Sex was de- 
termined from the student narne if no other inforrna-V 
tion was available.*) Values for all. 5 variables were 
determined for over 84 percent of the 23,45 1 ; values 
for at least 3 variables were determined for 95 percent. 
The most frequent value was imputed (for weighting) 
for missing values. , 

The crossing of the 5 classifier variables yielded a 
table with 96 cells (2x2 x 3x2x4)., The combining 
of cells with fewer than 20 respondents with similar 
cells yielded 81 weighting classes. Within each weighs y 
ing class,' the Respondents' unadjusted weights were^ — 
divided by the weighted response rate for that class to 
get the nonresponse adjustments. Six sets of adjusted 
weights were calculated-each set appropriate for 
analyses using a particular data set described in section " 
3 below. 

2. Weight Adjustment Formulae 

For each student-j selected from school-hi and 
classified in weighting class-k (k = 1 ,2, 87), the Kfoj 
and Lhjj were defined: 

1 if student-hij belongs to weighting class-k, 

K hij - or 

0 otherwise; and 

1 if student-hij completed the question- 
Lftij = tf naire(s| to be in data set-fi, or 

0 otherwise. 

Then the nonresponse weights for data set-fi (9. = 1,2, 

...,6) were computed as .•' ' 



2 Khij w iyiij 

hiKkj^Wuhij^j^^..^..^.. 

hij .• • • 
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3. Adjusted Weight Sets 

Table 6-1 shows the number of sample students 
in each of 5 response groups, determined by which 
questionnaires the students completed: 16,683* (groups 
I and II) completed the Base-Year Student Question- 
naire; limited^b^eyear data were collected using Pbrm 
' B during the first followup survey from additional 
sample students (resurvey respondents) who had not 
completed the Base-Year Student Questionnaire/Thus, 
data for,base-year items 2, 5, 8, 10, 16, 27, 83 , 84, 88, 
91, 92, 93, 94, and 95 (items 86-99, First FbUowup . 
Questionnaire Form B) were obtained from 21,222 
students (groups I, II, and IV). Two sets of nOnre- 
sponse adjusted student weights were computed for 
analyses of base-year data-W2 for analyses of the 14 
base-year items listed above and Wl for all other 
base-year questionnaire items. 

There were 21,350 respondents (groups I, III, 
and IV) to the 4 First, Followup Questionnaire. The W3 
weights are appropriate for analyses of items from this 
questionnaire only f j 

Analyses of change (or transition) variables, 
derived using both base-year and first followup iUrns 
should be carried out using either the W4 or the W5 
weights: W5 for the change variables defined using 
base-year items 2, 5, 8; 10, 1 6,27, 83, .84, 88, 91, 92, 
93, 94, and 95; W4 for those based on other base-year 
items in conjunction with first followup items. 
Matched base-year and first followup data are available 
for 15,635 students (group I) for most variables and 
for 20,174 students (gjoups 1 and IV) for the 14. 
base-year variables listed above. 

Table 6-1 .-Groups defined by questionnaire responses 



Completed Completed Completed 

Response Base- Year • First First 

group Student Follbwup. Followup 

Questionnaire Form A Form B 



Number 

of 
students 



1 


yes 


yes 


no 


15,635 


II 


yes, 


no 


no 


1 ,048 


III . 


n <* 


yes 


no 


1,176 


IV 


no 


no 


yes 


4,539 


V 


no 


no 


no 


1,053 



t 

f The last set of weights (W6) is appropriate for 

* analyses involving every student on the NLS release 
/■ tape. Ther^ are 22,398 student records (groups I, II, 



III, and. IV) on the tape-one for each student who 
completed a Base-Year Student Questionnaire and/or a 
First Followup Questionnaire. The remaining l t 053 
students '(group V) who did not complete either 
questionnaire (but are in th&sample) do not appear on 
the release tape. However, they do\ appear on the 
master data file. } 

The user should choose the set of adjusted 
weights which is appropriate to the data set and" 
variables to be analyzed. Table 6-2 lists the data set aricl 
variables appropriate to the weight sets-Wl, W2, W3, 
W4, W5,'and W6. For each weight set, the adjusted 
weights for nonrespondents are 0 and the sum of the 
respondents' adjusted weights equals the sum of the 
unadjusted weights for the- entire sample. 

As mentioned previously, the weights are ad- 
justed only for. questionnaire nonresponse, not for item 
nonresponse. Tlie same method could be used to 
obtain another set of weights, adjusted for both 
questionnaire and item nonresponse, for any question • 
naire item or variable. In most cases, the gains from 
such an adjustment would'not be expected to outweigh 
the additional cost. 

Table 6-2-Weights appropriate for data sets and vari- 
ables > 



Weight 
set 



Response-group data set 



. Survey variables 



Wl 



W2 



Respondents to Base-Year 

.Student Questionnaire 
A " (B-Y) 

Respondents to the B«Y or 
the First* Followup Ques- 
tionnaire Form B (FFU-B) 



W3 Respondents to FFU 

W4 Respondents to the B-Y and 
the FFU-A,or the FFU-B 



W5 Respondents to either the 
B Y and the FFU-A,or 
the FFU-B 

W6 Respondents to either tl 
B-Y or the FFU 



Variables defined by 
items from the B-Y 

Variables defined by 
B-Y items 2, 5, 8, 10 

16, 27j 83, 84, 88, 9lf' 
f 2, 93,94/and 95 
Variables defined by 

FFU items 
Change variables defined ' 
byj terns from both 
the B-Y and the FFU 
Change variables defined^ 
by B-Y items 2, 5, 8, 10 
10, 16,27, 83,84,88, 
91, 92, 93, 94, and 95 
and the FFU items 
Variables with values de*^ 
fined from data avail- 
,able for each student % 
.the release file 
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